-- Logs begin at Mon 2022-08-01 13:15:43 UTC, end at Mon 2022-08-01 14:27:44 UTC. -- Aug 01 13:58:57.852533 dv-cinder-845178-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 13:58:57.864061 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 13:58:57 2022] *** Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: nodename: dv-cinder-845178-10-iscsi Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: machine: x86_64 Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: clock source: unix Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: pcre jit disabled Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: detected number of CPU cores: 4 Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: current working directory: / Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: detected binary path: /usr/bin/uwsgi-core Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: your processes number limit is 47680 Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: your memory page size is 4096 bytes Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: detected max file descriptor number: 2048 Aug 01 13:58:57.866254 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: lock engine: pthread robust mutexes Aug 01 13:58:57.867629 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: thunder lock: enabled Aug 01 13:58:57.867629 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 13:58:57.867629 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 13:58:57.908203 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: Python main interpreter initialized at 0x555b25faf9c0 Aug 01 13:58:57.908203 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: python threads support enabled Aug 01 13:58:57.908203 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: your server socket listen backlog is limited to 100 connections Aug 01 13:58:57.908203 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: your mercy for graceful operations on workers is 90 seconds Aug 01 13:58:57.908635 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 13:58:57.908635 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: *** Operational MODE: preforking *** Aug 01 13:58:57.908967 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: *** uWSGI is running in multiple interpreter mode *** Aug 01 13:58:57.908967 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: spawned uWSGI master process (pid: 103565) Aug 01 13:58:57.909180 dv-cinder-845178-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 13:58:57.910085 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: spawned uWSGI worker 1 (pid: 103566, cores: 1) Aug 01 13:58:57.910085 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: spawned uWSGI worker 2 (pid: 103567, cores: 1) Aug 01 13:58:57.910261 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 13:58:58.607315 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 13:58:58.638060 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 13:58:59.694894 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 13:58:59.694894 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: from cryptography.utils import int_from_bytes Aug 01 13:58:59.695549 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 13:58:59.695549 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: from cryptography.utils import int_from_bytes Aug 01 13:58:59.716649 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 13:58:59.716649 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: from cryptography.utils import int_from_bytes Aug 01 13:58:59.717323 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 13:58:59.717323 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: from cryptography.utils import int_from_bytes Aug 01 13:59:02.244338 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 13:59:02.245218 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 13:59:02.245218 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 13:59:02.245471 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 13:59:02.245719 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 13:59:02.246138 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.246452 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.246742 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.247053 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.247323 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 13:59:02.247804 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.247922 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 13:59:02.248073 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.248073 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.248241 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 13:59:02.248351 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.248512 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 13:59:02.248792 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 13:59:02.248918 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.249002 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.249109 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.249323 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.249423 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.249671 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-10-iscsi {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.249829 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.249948 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.250100 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.250254 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.250365 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.250565 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.250681 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.250841 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.251028 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.251211 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.251360 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.251494 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.251625 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.251770 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.251893 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.252116 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.252363 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.252504 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-10-iscsi {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.252669 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.252949 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.253166 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.253370 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.253506 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.253623 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.253735 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.253861 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.253981 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.254161 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.254327 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.254490 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.254619 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.254757 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.254895 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.255144 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.255334 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.255473 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.255607 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.255799 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.255974 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-10-iscsi {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.256106 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.256230 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.256455 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.256657 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.256774 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.256888 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.257016 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.257211 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.257341 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.257610 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.257766 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.257874 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.257983 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.258169 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.258285 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.258498 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.258628 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-10-iscsi {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.258800 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.258930 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.259116 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.259250 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.259427 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.259550 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.259731 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.259962 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.260103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.260226 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.260380 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.260518 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.260692 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.260848 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.261006 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.261174 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.261306 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.261514 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.261640 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.261816 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.261989 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.262199 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.262517 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.262720 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.262915 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.262915 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.263200 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.263200 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.263443 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.263565 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.263684 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.263684 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.263936 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.264079 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.264212 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.264369 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.264491 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.264610 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.264742 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.264878 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.265007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.265134 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.265255 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.265381 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.265509 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.265651 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.265783 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.265904 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.266024 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.266146 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.266266 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.266395 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.266516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.266644 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.266764 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.266954 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.267143 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.267343 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.267542 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.267672 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.267793 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.267922 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.268054 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.268175 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.268359 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.268601 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.268738 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.268860 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.268994 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.269116 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.269268 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.269462 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.269667 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.269813 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.269947 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.270078 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.270199 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.270331 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.270460 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.270634 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.270810 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.271000 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.271159 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.271288 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.271417 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.271548 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.271686 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.271870 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.272042 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.272181 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.272394 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.272642 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.272774 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.272895 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.273014 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.273133 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.273262 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.273416 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.273537 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.273661 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.273814 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.273935 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.274064 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.274184 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.274368 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.274497 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.274653 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.274780 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.274962 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.275084 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.275256 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.275389 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.275545 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.275682 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.275843 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.275970 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.276146 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.276293 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.276481 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.276622 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.276774 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.276916 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.277068 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.277194 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.277372 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.277514 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.277666 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.277791 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.278353 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.278482 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.278637 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.278769 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.278934 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.279057 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.279231 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.279369 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.279530 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.279667 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.279815 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.280038 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.280163 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.280363 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.280487 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.280650 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.280779 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.280963 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.281088 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.281263 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.281386 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.281569 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.281701 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.281880 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.282016 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.282182 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.282337 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.282469 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.282615 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.282827 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.282951 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.283070 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.283190 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.283323 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.283453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.283627 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.283760 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.283925 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.284089 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.284359 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.284498 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.284661 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.284787 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.284963 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.285097 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.285261 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.285373 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.285558 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.285681 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.285854 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.285986 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.286150 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.286274 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.286444 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.286575 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.286862 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.287045 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.287170 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.287290 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.287410 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.287529 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.287686 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.287984 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.287984 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.288237 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.288237 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.288498 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.288676 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.288838 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.289013 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.289137 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.289264 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.289385 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.289514 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.289636 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.289764 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.289886 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.290066 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.290207 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.290338 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.290460 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.290611 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.290767 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.290969 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 13:59:02.291138 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.291273 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.291395 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.291582 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.291771 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.291938 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.292093 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.292223 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.292405 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.292537 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.292659 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.292936 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.293151 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.293347 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.293556 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.293760 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.293952 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.294149 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.294355 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.294563 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.294766 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.295003 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.295215 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.295419 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.295630 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.295812 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.295925 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.295925 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.296173 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.296397 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.296610 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.296808 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.296996 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.297161 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.297325 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.297517 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.297728 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.297898 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.298069 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.298229 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.298391 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.298564 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.298746 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.298907 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.299068 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.299235 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.299412 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.299591 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.299800 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.299984 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.300167 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.300448 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.300643 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.300829 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.301000 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.301176 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.301319 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.301493 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.301654 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.301830 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.301993 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.302155 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.302299 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.302440 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.302598 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.302756 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.302969 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.303241 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.303403 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.303568 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.303750 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.303913 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.304071 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.304229 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.304566 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.304924 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.305111 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.305293 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.305480 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.305602 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.305714 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.305819 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.305950 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.306071 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.306191 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.306311 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.306431 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.306565 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.306687 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.306807 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.306926 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.307045 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.307156 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.307283 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.307405 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.307524 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.307642 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.307761 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.307880 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.308015 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.308136 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.308256 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.308412 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.308534 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.308654 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.308802 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.309012 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.309147 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.309267 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.309387 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.309506 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.309506 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.309748 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.309870 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.309990 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.310110 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.310238 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.310360 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.310488 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.310608 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.310741 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.310870 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.311079 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.311201 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.311329 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.311449 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.311574 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.311693 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.311822 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.311942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.312062 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.312180 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.312388 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.312509 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.312610 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.312692 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.312779 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.312779 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.312931 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.313020 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.313020 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.313222 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.313317 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.313400 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.313538 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.313670 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.313790 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.313911 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.314066 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.314220 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.314376 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.314517 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.314706 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.314831 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.315044 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.315184 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.315358 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.315485 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.315661 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.315790 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.315970 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.316094 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.316293 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.316421 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.316598 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.316734 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.316901 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.317026 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.317206 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.317334 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.317504 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.317627 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.317805 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.317930 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.318106 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.318241 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.318405 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.318530 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.318703 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.318836 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.319020 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.319145 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.319323 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.319448 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.319620 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.319754 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.319917 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.320056 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.320216 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.320378 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.320542 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.320674 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.320871 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.321006 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.321178 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.321302 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.321571 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.321717 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.321841 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.321962 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.322083 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.322212 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.322403 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.322531 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.322709 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.322832 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.323012 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.323136 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.323316 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.323450 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.323619 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.323752 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.323923 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.324047 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.324235 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.324419 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.324567 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.324694 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.324879 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.325003 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.325244 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.325368 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.325488 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.325617 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.325776 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.325894 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.326087 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.326212 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.326385 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.326517 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.326693 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.326826 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.327001 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.327125 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.327326 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.327451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.327728 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.327940 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.331322 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.331468 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.331613 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.331740 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.331873 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.332009 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.332133 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.332253 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.332411 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.332534 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.332655 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.332790 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.332912 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.333042 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.333164 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.333291 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.333421 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.333542 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.333662 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.333781 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.333781 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.334008 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.334143 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.334273 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.334394 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.334513 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.334632 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.334760 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.334891 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.335012 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.335133 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.335265 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.335490 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.335615 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.335745 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.335866 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.335979 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.336085 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.336205 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.336330 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.336471 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.336594 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.336715 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.336835 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.336955 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.337084 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.337207 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.337353 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.337542 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.337736 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.337935 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.338141 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.338322 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.338507 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.338696 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.338891 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.339084 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.339288 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.339477 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.339680 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.339880 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.340067 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.340252 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.340572 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.340762 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.340924 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.341083 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.341265 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.341551 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.341692 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.341817 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.341946 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.342081 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.342204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.342204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.342443 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.342564 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.342685 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.342805 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.342931 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.343062 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.343183 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.343312 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.343435 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.343555 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.343674 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.343803 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.343924 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.344053 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.344176 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.344316 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.344459 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.344589 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.344711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.344831 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.344831 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.345065 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.345201 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.345323 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.345450 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.345695 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.345821 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.345942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.346059 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.346166 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.346284 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.346395 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.346529 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.346644 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.346796 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.346905 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347009 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347113 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347226 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347340 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347476 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347607 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347677 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347742 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347807 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347883 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347968 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.347968 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.348119 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.348199 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.348318 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.348414 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.348495 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.348574 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.348700 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.348834 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.348969 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.349131 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.349272 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.349421 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.349550 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.349812 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.349968 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.350109 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.350251 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.350411 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.350549 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.350685 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.350685 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.350685 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.351070 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.351207 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.351345 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.351345 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.351618 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.351756 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.351893 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.352007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.352143 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.352309 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.352616 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.352782 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.352926 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.353162 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.353291 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.353629 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.353724 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.353978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.354149 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.354286 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.354600 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.354692 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.354949 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.355059 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.355252 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.355449 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.355655 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.355851 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.355984 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.356354 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.356470 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.356636 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.356809 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.356954 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.357268 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.357375 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.357575 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.357676 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.357944 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.358197 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.358305 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.358511 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.358656 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.358900 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.358990 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.359225 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.359365 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.359530 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.359861 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.359954 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.360211 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.360323 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.360575 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.360743 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.361019 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.361119 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.361201 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.361457 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.361626 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.361935 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.362030 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.362416 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.362509 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.362796 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.362896 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.363157 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.363255 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.363466 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.363688 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.363814 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.367245 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.367398 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.367512 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.367604 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.367686 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.367686 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.368029 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.368173 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.368173 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.368416 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.368566 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.368566 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.368832 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.368956 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.368956 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.369238 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.369371 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.369371 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.369631 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.369759 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.369759 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.370052 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.370175 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.370316 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.370484 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.370484 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.370717 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.370838 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.370838 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.371087 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.371220 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.371220 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.371469 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.371630 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.371764 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.371900 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.371900 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.372132 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.372323 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.372323 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.372606 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.372723 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.372830 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.372951 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.372951 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.373236 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.373415 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.373415 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.373747 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.373955 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.374166 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.374349 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.374575 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.374886 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.375090 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.375284 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.375284 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.375654 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.375845 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.375845 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.376196 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.376435 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.376435 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.376821 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.377026 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.377026 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.377456 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.377595 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.377743 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.377887 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.378018 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.378149 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.378301 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.378616 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.378763 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.379004 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.379311 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.379485 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.379619 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.379907 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.380049 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.380252 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.380441 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.380627 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.380935 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.381062 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.381264 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.381578 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.381717 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.381956 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.382083 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.382335 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.382588 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.382736 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.382930 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.383103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.383292 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.383618 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.383835 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.384032 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.384223 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.384441 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.384632 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.384837 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.385028 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.385227 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.385424 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.385621 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.385810 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.386018 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.386215 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.386442 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.386644 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.386845 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.387037 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.387254 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.387478 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.387717 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.387845 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.388060 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.388193 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.388411 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.388689 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.388817 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.388997 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.389290 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.389452 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.389647 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.389884 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.390022 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.390299 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.390422 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.390615 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.390886 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.391023 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.391227 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.391429 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.391586 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.391898 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.392036 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.392230 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.392586 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.392770 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.392922 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.393210 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.393354 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.393720 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.393945 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.394077 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.394348 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.394495 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.394649 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.394971 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.395172 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.395372 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.395584 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.395775 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.396009 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.396203 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.396470 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.396668 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.396878 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.397064 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.397274 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.397478 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.397694 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.398011 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.398210 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.398409 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.398606 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.398606 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.398994 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.398994 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.399379 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.399566 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.399762 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.399955 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.400144 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.400144 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.400560 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.400770 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.400770 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.401132 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.401342 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.401342 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.401709 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.401909 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.402084 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.402249 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.402395 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.402669 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.402822 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.403332 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.403480 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.403480 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.403765 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.403932 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.404077 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.404220 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.404410 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.404598 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.404757 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.404903 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.405053 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.405208 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.405320 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.405529 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.405660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.405791 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.405913 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.406075 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.406209 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.406209 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.406526 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.406651 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.406771 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.406921 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.407071 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.407187 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.407301 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.407431 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.407569 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.407739 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.407865 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.408064 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.408370 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.408370 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.408748 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.409043 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.409354 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.409354 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.409757 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.409930 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.410097 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.410304 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.410493 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.410689 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.410885 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.411077 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.411262 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.411408 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.411587 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.411806 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.411984 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.412186 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.412497 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.412594 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.412746 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.412841 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.412924 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.413104 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.413206 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.413350 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.413456 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.413565 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.413672 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.413753 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.413865 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.413951 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.414064 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.414158 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.414275 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.414372 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.414509 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.414735 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.414863 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.414999 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.415087 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.415241 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.415413 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.415592 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.415738 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.415885 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.416023 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.416168 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.416416 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.416554 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.416677 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.416834 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.417007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.417249 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.417377 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.417557 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.417692 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.417894 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.418031 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.418228 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.418441 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.418624 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.418720 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.418815 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.418924 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.419136 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.419281 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.419468 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.420455 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.420744 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.421053 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.421259 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.421462 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.421740 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.421967 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.422094 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.422216 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.422338 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.422460 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.422460 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.422690 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.422814 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.422814 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.422814 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.423150 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.423271 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.423406 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.423530 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.423530 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.423759 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.423879 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.423999 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.424222 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.424398 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.424553 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.424925 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.425054 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.425280 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.425488 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.425683 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.425878 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.426010 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.426196 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.426410 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.426547 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.426731 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.426913 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.427087 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.427202 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.427342 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.427530 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.427651 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.427765 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.427978 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.428177 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.428403 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.428662 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.428858 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.429109 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.429257 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.429470 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.429664 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.429826 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.429961 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.430159 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.430293 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.430459 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.430624 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.430762 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.430926 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.431117 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.431346 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.431561 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.431561 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.431885 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.431885 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.432145 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.432145 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.432429 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.432537 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.432685 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.432794 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.432893 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.433040 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.433193 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.433311 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.433457 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.433569 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.433685 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.433853 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.433962 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.434204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.434352 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.434525 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.434829 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.435003 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.435146 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.435287 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.435514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.435641 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.435760 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.435890 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.436138 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.436311 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.436460 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.436600 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.436759 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.436903 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.437077 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.437230 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.437389 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.437486 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.437749 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.437932 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.438060 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.438243 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.438456 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.438679 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.438927 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.439127 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.439323 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.439501 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.439501 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.439788 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.439987 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.440131 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.440370 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.440517 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.440639 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.440809 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.440961 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.441121 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.441300 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.441465 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.441670 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.441799 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.441945 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.442071 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.442224 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.442396 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.442574 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.442773 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.442921 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.443077 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.443204 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.443355 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.443542 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.443734 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.443893 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.444030 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.444191 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.444378 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.444651 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.444784 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.444955 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.445152 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.445334 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.445513 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.445677 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.445806 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.445913 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.446105 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.446265 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.446419 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.446618 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.446797 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.446973 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.447120 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.447286 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.447499 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.447671 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.447866 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.447986 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.447986 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.448245 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.448448 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.448628 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.448818 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.449081 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.449245 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.449460 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.449648 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.449802 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.449940 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.450062 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.450236 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.450429 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.450572 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.450889 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.451020 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.451167 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.451293 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.451474 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.451643 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.451827 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.451997 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.452147 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.452314 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.452644 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.452776 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.452924 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.453059 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.453205 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.453205 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.453541 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.453740 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.453740 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.454089 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.454263 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.454399 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.454606 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.454736 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.454884 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.455045 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.455252 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.455415 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.455611 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.455825 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.456064 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.456252 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.456470 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.456619 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.456771 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.456771 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.457042 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.457196 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.457377 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.457520 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.457713 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.457878 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.458191 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.458374 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.458583 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.458733 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.458904 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.459094 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.459299 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.459425 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.459557 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.459680 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.459918 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.460090 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.460323 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.460726 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.460888 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.461088 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.461234 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.461403 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.461575 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.461763 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.461909 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.462048 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.462180 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.462340 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.462467 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.462599 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.462721 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.462842 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.462842 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.463071 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.463071 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.463303 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.463303 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.463532 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.463656 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.463776 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.463912 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.464035 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.464155 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.464295 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.464418 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.464551 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.464682 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.464803 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.464926 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.465045 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.465045 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.465287 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.465418 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.465547 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.465672 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.465792 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.465912 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.466041 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.466164 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.466293 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.466422 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.466543 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.466675 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.466805 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.466934 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.467055 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.467247 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.467373 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.467562 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.467696 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.467871 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.467996 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.468177 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.468509 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.468652 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.468853 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.469024 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.469178 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.469385 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.469518 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.469652 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.469837 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.469972 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.470149 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.470274 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.470455 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.470589 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.470766 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.470891 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.471091 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.471215 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.471403 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.471560 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.471761 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.471896 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.472069 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.472191 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.472574 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.472715 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.472715 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.472999 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.473125 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.473346 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.473573 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.473812 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.474492 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.474621 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.474744 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.474865 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.475000 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.475123 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.475244 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.475365 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.475493 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.475493 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.475734 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.475855 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.475984 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.476105 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.476226 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.476380 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.476770 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.476918 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.477051 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.477173 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.477304 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.477438 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.477558 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.477680 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.477800 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.477920 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.478049 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.478170 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.478292 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.478443 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.478567 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.478756 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.478939 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.479065 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.479193 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.479341 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.479475 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.479671 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.479808 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.479931 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.480086 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.480264 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.480566 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.480753 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.480958 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.481162 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.481323 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.481449 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.481580 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.481711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.481848 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.481970 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.482091 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.482213 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.482345 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.482476 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.482597 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.482717 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.482837 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.482961 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.483133 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.483267 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.483430 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.483563 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.483734 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.483858 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.484028 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.484162 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.484354 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.484482 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.484653 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.484779 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.484956 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.485089 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.485253 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.485422 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.485544 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.485665 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.485893 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.486027 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.486207 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.486331 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.486505 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.486638 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.486803 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.486927 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.487134 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.487333 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.487456 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.487622 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.487903 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.488028 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.488159 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.488361 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.488485 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.488742 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.488742 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.488983 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.489109 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.489250 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.489432 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.489633 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.489911 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.489911 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.490159 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.490282 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.490410 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.490547 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.490670 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.490791 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.490911 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.491040 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.491172 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.491297 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.491417 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.491584 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.491771 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.491964 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.492121 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.492245 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.492390 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.492542 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.492687 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.492857 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.493124 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.493251 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.493484 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.493671 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.493874 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.494101 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.494239 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.494474 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.494704 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.494868 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.495054 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.495245 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.495428 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.495686 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.495830 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.495994 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.496178 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.496362 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.496533 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.496655 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.496850 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.496988 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.497170 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.497358 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.497486 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.497609 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.497779 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.497905 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.498096 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.498222 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.498432 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.498584 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.498745 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.498870 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.499060 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.499194 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.499373 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.499497 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.499687 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.499811 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.500042 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.500166 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.500323 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.500462 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.500584 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.500713 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.500891 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.501016 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.501235 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.501357 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.501545 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.501757 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.501887 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.502073 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.502198 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.502378 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.502502 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.502867 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.502999 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.503122 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.503251 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.503431 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.503564 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.503746 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.503871 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.504054 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.504178 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.504402 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.504540 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.504722 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.504845 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.505029 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.505153 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.505345 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.505477 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.505650 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.505781 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.505976 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.506102 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.506313 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.506446 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.506626 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.506756 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.506938 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.507064 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.507233 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.507358 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.507486 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 13:59:02.507613 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.507813 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.508116 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.508461 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.508765 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.509061 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.509367 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.509666 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.509962 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.510259 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.510552 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.510848 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.511152 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.511446 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.511736 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.512031 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.512348 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.512646 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.512941 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.513240 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.513533 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.513827 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.514120 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.514414 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.514705 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.515029 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.515353 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.515660 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.515969 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.516333 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.516711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.516972 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.517204 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.517515 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.517824 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.518186 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.518502 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.518808 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.519229 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.519413 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.519717 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.520203 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.520439 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.520659 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.520981 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.521279 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.521597 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.521904 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.522214 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.522640 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.522822 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.525103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.525103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.525103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.525103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.525103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.525103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.525103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.526209 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.526209 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.526209 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.526560 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.526681 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.526907 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.527209 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.527521 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.527841 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.528576 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.528881 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.529218 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.529535 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.529843 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.530147 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.530445 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 13:59:02.530682 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 13:59:02.665039 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO dbcounter [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Registered counter for database nova_api Aug 01 13:59:02.687129 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_db.sqlalchemy.engines [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 13:59:02.690094 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO dbcounter [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Registered counter for database nova_api Aug 01 13:59:02.694862 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writer thread running {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 13:59:02.710670 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG oslo_db.sqlalchemy.engines [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 13:59:02.718472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writer thread running {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 13:59:02.751776 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.context [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b931c80f-59a5-40eb-8557-eb4bfa964b56(cell1) {{(pid=103567) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 13:59:02.755935 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 13:59:02.757728 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 13:59:02.758408 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 13:59:02.760509 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 13:59:02.762598 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO dbcounter [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Registered counter for database nova_cell0 Aug 01 13:59:02.768597 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO dbcounter [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Registered counter for database nova_cell1 Aug 01 13:59:02.777234 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.context [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b931c80f-59a5-40eb-8557-eb4bfa964b56(cell1) {{(pid=103566) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 13:59:02.777454 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_db.sqlalchemy.engines [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 13:59:02.777816 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_db.sqlalchemy.engines [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 13:59:02.780659 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG oslo_concurrency.lockutils [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 13:59:02.782444 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG oslo_concurrency.lockutils [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 13:59:02.783381 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG oslo_concurrency.lockutils [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 13:59:02.785847 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG oslo_concurrency.lockutils [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 13:59:02.786078 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writer thread running {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 13:59:02.787533 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writer thread running {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 13:59:02.788011 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO dbcounter [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Registered counter for database nova_cell0 Aug 01 13:59:02.794533 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO dbcounter [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Registered counter for database nova_cell1 Aug 01 13:59:02.805028 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG oslo_db.sqlalchemy.engines [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 13:59:02.806930 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG oslo_db.sqlalchemy.engines [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 13:59:02.813571 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writer thread running {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 13:59:02.815063 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writer thread running {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 13:59:02.935947 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO dbcounter [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Registered counter for database nova_cell0 Aug 01 13:59:02.943927 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_db.sqlalchemy.engines [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 13:59:02.948637 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writer thread running {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 13:59:02.970035 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO dbcounter [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Registered counter for database nova_cell0 Aug 01 13:59:02.979900 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG oslo_db.sqlalchemy.engines [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 13:59:02.984538 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writer thread running {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 13:59:03.289634 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: WARNING keystonemiddleware.auth_token [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 13:59:03.297212 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: WARNING keystonemiddleware.auth_token [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 13:59:03.305536 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: WARNING keystonemiddleware.auth_token [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 13:59:03.313101 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: WARNING keystonemiddleware.auth_token [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 13:59:03.644018 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: WARNING keystonemiddleware.auth_token [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 13:59:03.650136 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: WARNING keystonemiddleware.auth_token [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 13:59:03.655825 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b25faf9c0 pid: 103567 (default app) Aug 01 13:59:03.657987 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 13:59:03.659245 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001792 Aug 01 13:59:03.659650 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Mon Aug 1 13:59:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 13:59:03.661448 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: WARNING keystonemiddleware.auth_token [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 13:59:03.667661 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: WARNING keystonemiddleware.auth_token [None req-623719c1-a07a-4318-ac99-dbd5a6dae8a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 13:59:03.673043 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b25faf9c0 pid: 103566 (default app) Aug 01 14:00:29.711189 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:29.712952 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Aug 01 14:00:29.714271 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:00:29.736401 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writing DB stats nova_api:SELECT=3 {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:29.737453 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writing DB stats nova_cell1:SELECT=3 {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:29.739069 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writing DB stats nova_cell0:SELECT=3 {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:29.740169 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writing DB stats nova_cell0:SELECT=3 {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:30.802366 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-360395a3-20a2-4881-b68f-fcaa5f0c1c1e admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:30.836435 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-360395a3-20a2-4881-b68f-fcaa5f0c1c1e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.113215 Aug 01 14:00:30.844379 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Mon Aug 1 14:00:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:33.442386 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:33.443855 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-256016df-cda5-4ee5-a996-3f4ba9ca87d2 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 01 14:00:33.450130 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:00:33 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:00:34.015050 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-67125be6-c958-4f4c-99e4-bb16950f8ed0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "id": "c1", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:34.046273 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:00:34.046273 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: warnings.warn(msg) Aug 01 14:00:34.092921 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-67125be6-c958-4f4c-99e4-bb16950f8ed0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.642006 Aug 01 14:00:34.094103 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:00:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:00:34.112590 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_api:SELECT=3 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:34.113900 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_cell1:SELECT=3 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:34.115651 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_cell0:SELECT=3 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:34.116739 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:34.399905 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-edc704ff-3b5b-44b3-ac2a-5793f47373fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:34.404489 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:00:34.404489 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: warnings.warn(msg) Aug 01 14:00:34.497302 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-edc704ff-3b5b-44b3-ac2a-5793f47373fe admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.392271 Aug 01 14:00:34.499325 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 14:00:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:00:37.043909 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-67125be6-c958-4f4c-99e4-bb16950f8ed0 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:37.045355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-67125be6-c958-4f4c-99e4-bb16950f8ed0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Aug 01 14:00:37.045830 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:00:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:00:38.013086 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-268b544f-a7d4-47e5-9d6f-282d17a162b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:38.050764 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:00:38.050764 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: warnings.warn(msg) Aug 01 14:00:38.085793 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-268b544f-a7d4-47e5-9d6f-282d17a162b4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.032260 Aug 01 14:00:38.087739 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:00:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:00:38.100660 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-8f6c8f35-1dd6-4ab6-8790-966d0f74880c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:38.105011 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:00:38.105011 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: warnings.warn(msg) Aug 01 14:00:38.145292 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-8f6c8f35-1dd6-4ab6-8790-966d0f74880c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048629 Aug 01 14:00:38.146281 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 14:00:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:40.779023 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-268b544f-a7d4-47e5-9d6f-282d17a162b4 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:40.779930 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-268b544f-a7d4-47e5-9d6f-282d17a162b4 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 01 14:00:40.780365 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:00:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:00:41.400444 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-db7eb766-39e3-494d-af0c-39b4101fad12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "id": "d2", "disk": 10, "ram": 1024, "swap": 0}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:41.426833 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-db7eb766-39e3-494d-af0c-39b4101fad12 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.639995 Aug 01 14:00:41.427386 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:00:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:00:41.445948 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-895ff1c9-c080-409f-bb56-f99a65762a27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:41.474610 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-895ff1c9-c080-409f-bb56-f99a65762a27 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033940 Aug 01 14:00:41.475205 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 14:00:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:43.866465 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-db7eb766-39e3-494d-af0c-39b4101fad12 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:43.867529 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-db7eb766-39e3-494d-af0c-39b4101fad12 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 01 14:00:43.868050 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:00:44.464759 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-c2478838-903c-40cc-8177-5f8632055b50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:44.499832 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-c2478838-903c-40cc-8177-5f8632055b50 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.624956 Aug 01 14:00:44.504697 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:00:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:00:44.516883 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-59635b40-4bcc-4fec-a33e-e4f27b821326 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:44.558420 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-59635b40-4bcc-4fec-a33e-e4f27b821326 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045130 Aug 01 14:00:44.560303 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 14:00:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:47.163900 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-c2478838-903c-40cc-8177-5f8632055b50 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:47.165119 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-c2478838-903c-40cc-8177-5f8632055b50 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Aug 01 14:00:47.165524 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:00:47.713539 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-4bb44d35-4385-4b91-a1b6-6f0db4bb0db8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "id": "d4"}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:47.736937 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-4bb44d35-4385-4b91-a1b6-6f0db4bb0db8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.564584 Aug 01 14:00:47.737707 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:00:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:00:47.757608 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-142d313f-746c-4f80-a9de-6dc09a180357 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:47.798272 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-142d313f-746c-4f80-a9de-6dc09a180357 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049258 Aug 01 14:00:47.807445 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 14:00:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:50.391627 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-4bb44d35-4385-4b91-a1b6-6f0db4bb0db8 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:50.392909 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-4bb44d35-4385-4b91-a1b6-6f0db4bb0db8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002339 Aug 01 14:00:50.393412 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:00:50.986919 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-387d84f7-e37b-4c9d-91dd-57ae7b5dbfe7 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:51.020832 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-387d84f7-e37b-4c9d-91dd-57ae7b5dbfe7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.618500 Aug 01 14:00:51.021416 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Mon Aug 1 14:00:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:00:54.193123 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-4bb44d35-4385-4b91-a1b6-6f0db4bb0db8 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:54.194789 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-4bb44d35-4385-4b91-a1b6-6f0db4bb0db8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002495 Aug 01 14:00:54.195554 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:00:54.868603 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-914bea85-2011-43a3-8676-4fe3cc8b16a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:54.891833 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-914bea85-2011-43a3-8676-4fe3cc8b16a8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.686023 Aug 01 14:00:54.892429 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:00:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:00:54.905556 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-0a7a5a18-5bc8-42b7-bbf4-2e7efa8d0376 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:54.938651 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-0a7a5a18-5bc8-42b7-bbf4-2e7efa8d0376 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037028 Aug 01 14:00:54.939234 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 14:00:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:00:57.440125 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-914bea85-2011-43a3-8676-4fe3cc8b16a8 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:57.441411 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-914bea85-2011-43a3-8676-4fe3cc8b16a8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 01 14:00:57.441808 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:00:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:00:57.890242 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-4e569a8c-e24e-4696-abb1-356940ba6ea3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "disk": 20}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:57.914316 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-4e569a8c-e24e-4696-abb1-356940ba6ea3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.465643 Aug 01 14:00:57.915014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:00:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:00:57.927992 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-efd8e42b-7e3e-479d-afb6-d8c1a9f806d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:00:57.956333 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-efd8e42b-7e3e-479d-afb6-d8c1a9f806d6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032040 Aug 01 14:00:57.957097 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 14:00:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:00.372258 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-4e569a8c-e24e-4696-abb1-356940ba6ea3 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:00.373308 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-4e569a8c-e24e-4696-abb1-356940ba6ea3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 01 14:01:00.373699 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:00.992627 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-c3d56df1-02d0-4215-991c-df1dd251ee5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:01.019437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-c3d56df1-02d0-4215-991c-df1dd251ee5e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.639705 Aug 01 14:01:01.027714 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:01.034417 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-6cae3165-1614-4c01-ace0-bf92c3c3ca77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:01.040469 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:01.076684 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-6cae3165-1614-4c01-ace0-bf92c3c3ca77 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046044 Aug 01 14:01:01.077367 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 14:01:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:01:03.500757 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-c3d56df1-02d0-4215-991c-df1dd251ee5e admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:03.502965 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-c3d56df1-02d0-4215-991c-df1dd251ee5e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002770 Aug 01 14:01:03.503984 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:01:03 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:01:04.137844 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-a3f0a66d-1b18-4d47-8570-5785505bd487 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "rxtx_factor": 1.0}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:04.168998 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-a3f0a66d-1b18-4d47-8570-5785505bd487 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.657521 Aug 01 14:01:04.169881 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:01:04.182281 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-a13ff48a-0a3e-4537-bef6-5ef757123652 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:04.210363 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-a13ff48a-0a3e-4537-bef6-5ef757123652 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032020 Aug 01 14:01:04.210962 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 14:01:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:06.714931 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-a3f0a66d-1b18-4d47-8570-5785505bd487 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:06.716701 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-a3f0a66d-1b18-4d47-8570-5785505bd487 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002492 Aug 01 14:01:06.717904 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:01:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:07.304209 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-7157637b-a578-438b-a2b7-b110bbe01058 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:07.309318 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:07.335895 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-7157637b-a578-438b-a2b7-b110bbe01058 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.608814 Aug 01 14:01:07.344132 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:07.350392 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-f9201f2e-4aaa-4218-8798-5e33e321fd7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:07.380339 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-f9201f2e-4aaa-4218-8798-5e33e321fd7e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031818 Aug 01 14:01:07.380339 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 14:01:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:26.002594 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-7157637b-a578-438b-a2b7-b110bbe01058 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:26.003967 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-7157637b-a578-438b-a2b7-b110bbe01058 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001849 Aug 01 14:01:26.004556 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:01:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:26.016507 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:26.506161 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-993b3170-3596-42fb-9992-16f8e1762873 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:26.525318 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-993b3170-3596-42fb-9992-16f8e1762873 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.513348 Aug 01 14:01:26.525908 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Mon Aug 1 14:01:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:01:27.704336 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-7157637b-a578-438b-a2b7-b110bbe01058 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:27.705576 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-7157637b-a578-438b-a2b7-b110bbe01058 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001741 Aug 01 14:01:27.706020 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:01:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:01:28.310775 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-cb07e752-4a7d-4507-b5b5-ce1462e4501d admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:28.316765 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.wsgi [None req-cb07e752-4a7d-4507-b5b5-ce1462e4501d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-cb07e752-4a7d-4507-b5b5-ce1462e4501d admin admin] Request method failure captured: Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Accept: application/json Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Accept-Encoding: gzip, deflate Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Connection: keep-alive Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Content-Length: 0 Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Host: 10.222.0.45 Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Openstack-Api-Version: compute 2.90 Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Openstack-System-Scope: None Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: User-Agent: python-novaclient Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Auth-Token: gAAAAABi59y31Sw4ZCGjxVFFDTISyu3J6ddwHQWEyp2Xci_GR9diVwRVDIainiy05yVwLt4JN5ithdxCQvIeITiUe5oQsKnlZLINTUmXolAq-it9cPUq5SiIKwIjkmjJpbnodbQbXOwd2kzHgukVSM8xcRDbaU1wAv70ISnNzVVX6mTP726QBZg Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Domain-Id: None Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Domain-Name: None Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Identity-Status: Confirmed Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Is-Admin-Project: True Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Domain-Id: default Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Domain-Name: Default Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Name: admin Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Role: reader,member,admin Aug 01 14:01:28.320014 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Roles: reader,member,admin Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a12613c4ac44ad788edb767368b347b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a12613c4ac44ad788edb767368b347b"}]}] Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Tenant: admin Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Tenant-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Tenant-Name: admin Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User: admin Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Domain-Id: default Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Domain-Name: Default Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Id: bf301c0e8be34b7fa129e68f7514a379 Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Name: admin Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: method: > Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: exception: Flavor 42 could not be found. Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: action_args: {'id': '42'} Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:01:28.322451 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:28.323436 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.324840 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-cb07e752-4a7d-4507-b5b5-ce1462e4501d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:01:28.326690 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-cb07e752-4a7d-4507-b5b5-ce1462e4501d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.473420 Aug 01 14:01:28.326690 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Mon Aug 1 14:01:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 14:01:28.332585 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-238af3b4-bf8f-4098-8bc6-c2331d495319 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:28.357764 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-238af3b4-bf8f-4098-8bc6-c2331d495319 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028903 Aug 01 14:01:28.358464 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 14:01:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:01:28.370256 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-2ed993cd-009c-4ddc-b0c3-ea370c0619ec admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:28.395879 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-2ed993cd-009c-4ddc-b0c3-ea370c0619ec admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029568 Aug 01 14:01:28.396502 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 14:01:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:01:28.407452 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-2b1f5d8b-2fad-4361-ba72-0f79429c70a8 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:28.413761 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.wsgi [None req-2b1f5d8b-2fad-4361-ba72-0f79429c70a8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-2b1f5d8b-2fad-4361-ba72-0f79429c70a8 admin admin] Request method failure captured: Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Accept: application/json Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Accept-Encoding: gzip, deflate Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Connection: keep-alive Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Content-Length: 0 Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Host: 10.222.0.45 Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Openstack-Api-Version: compute 2.90 Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Openstack-System-Scope: None Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: User-Agent: python-novaclient Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Auth-Token: gAAAAABi59y31Sw4ZCGjxVFFDTISyu3J6ddwHQWEyp2Xci_GR9diVwRVDIainiy05yVwLt4JN5ithdxCQvIeITiUe5oQsKnlZLINTUmXolAq-it9cPUq5SiIKwIjkmjJpbnodbQbXOwd2kzHgukVSM8xcRDbaU1wAv70ISnNzVVX6mTP726QBZg Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Domain-Id: None Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Domain-Name: None Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Identity-Status: Confirmed Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Is-Admin-Project: True Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Domain-Id: default Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Domain-Name: Default Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Name: admin Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Role: reader,member,admin Aug 01 14:01:28.417660 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Roles: reader,member,admin Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a12613c4ac44ad788edb767368b347b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a12613c4ac44ad788edb767368b347b"}]}] Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Tenant: admin Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Tenant-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Tenant-Name: admin Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User: admin Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Domain-Id: default Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Domain-Name: Default Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Id: bf301c0e8be34b7fa129e68f7514a379 Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Name: admin Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: method: > Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: exception: Flavor 42 could not be found. Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: action_args: {'id': '42'} Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:01:28.419516 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:28.421025 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:28.422204 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-2b1f5d8b-2fad-4361-ba72-0f79429c70a8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:01:28.423645 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-2b1f5d8b-2fad-4361-ba72-0f79429c70a8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015448 Aug 01 14:01:28.423645 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Mon Aug 1 14:01:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:01:29.467969 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-2ed993cd-009c-4ddc-b0c3-ea370c0619ec admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:29.469028 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-2ed993cd-009c-4ddc-b0c3-ea370c0619ec admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 01 14:01:29.469392 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:01:30.085063 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-cae9ddd2-0a28-40f5-9bbe-da5f481d12a7 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:30.092616 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.wsgi [None req-cae9ddd2-0a28-40f5-9bbe-da5f481d12a7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-cae9ddd2-0a28-40f5-9bbe-da5f481d12a7 admin admin] Request method failure captured: Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Accept: application/json Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Accept-Encoding: gzip, deflate Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Connection: keep-alive Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Content-Length: 0 Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Host: 10.222.0.45 Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Openstack-Api-Version: compute 2.90 Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Openstack-System-Scope: None Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: User-Agent: python-novaclient Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Auth-Token: gAAAAABi59y5xSM0GX0Fxk8cnybiHGVndYFQp6ft-PJK0DAsY0SK0YrEkASmu0o4grk10CzIDzKuaQH7nYHL9FF6ZLD8yqo4pH7xdWCQbrF43eQAGvo_PBLtBb1Z62zxFQMjArFNknGs_lJn6ikrQ0s-yNbQGWnCifNv5rv38dehKlQlX1RYDbM Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Domain-Id: None Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Domain-Name: None Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Identity-Status: Confirmed Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Is-Admin-Project: True Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Domain-Id: default Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Domain-Name: Default Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Name: admin Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Role: reader,member,admin Aug 01 14:01:30.094437 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Roles: reader,member,admin Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a12613c4ac44ad788edb767368b347b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a12613c4ac44ad788edb767368b347b"}]}] Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Tenant: admin Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Tenant-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Tenant-Name: admin Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User: admin Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Domain-Id: default Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Domain-Name: Default Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Id: bf301c0e8be34b7fa129e68f7514a379 Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Name: admin Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: method: > Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: exception: Flavor 84 could not be found. Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: action_args: {'id': '84'} Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:01:30.096824 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:30.097978 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.099453 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-cae9ddd2-0a28-40f5-9bbe-da5f481d12a7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:01:30.100868 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-cae9ddd2-0a28-40f5-9bbe-da5f481d12a7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.484420 Aug 01 14:01:30.100868 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Mon Aug 1 14:01:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 486 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:01:30.107489 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-6a6216e4-eed5-4263-a450-cde7220a9cda admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:30.125112 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-6a6216e4-eed5-4263-a450-cde7220a9cda admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021466 Aug 01 14:01:30.125688 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 14:01:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:01:30.137238 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-ab6eb5cc-991d-479d-9d22-7e3e44a3d1a5 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:30.154840 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-ab6eb5cc-991d-479d-9d22-7e3e44a3d1a5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021455 Aug 01 14:01:30.155436 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 14:01:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:01:30.171566 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-86dc4b43-c081-4430-8ad0-69680cf21454 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:30.177780 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.wsgi [None req-86dc4b43-c081-4430-8ad0-69680cf21454 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-86dc4b43-c081-4430-8ad0-69680cf21454 admin admin] Request method failure captured: Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Accept: application/json Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Accept-Encoding: gzip, deflate Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Connection: keep-alive Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Content-Length: 0 Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Host: 10.222.0.45 Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Openstack-Api-Version: compute 2.90 Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Openstack-System-Scope: None Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: User-Agent: python-novaclient Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Auth-Token: gAAAAABi59y5xSM0GX0Fxk8cnybiHGVndYFQp6ft-PJK0DAsY0SK0YrEkASmu0o4grk10CzIDzKuaQH7nYHL9FF6ZLD8yqo4pH7xdWCQbrF43eQAGvo_PBLtBb1Z62zxFQMjArFNknGs_lJn6ikrQ0s-yNbQGWnCifNv5rv38dehKlQlX1RYDbM Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Domain-Id: None Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Domain-Name: None Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Identity-Status: Confirmed Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Is-Admin-Project: True Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Domain-Id: default Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Domain-Name: Default Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Name: admin Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Role: reader,member,admin Aug 01 14:01:30.179355 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Roles: reader,member,admin Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a12613c4ac44ad788edb767368b347b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a12613c4ac44ad788edb767368b347b"}]}] Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Tenant: admin Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Tenant-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Tenant-Name: admin Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User: admin Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Domain-Id: default Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Domain-Name: Default Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Id: bf301c0e8be34b7fa129e68f7514a379 Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Name: admin Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: method: > Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: exception: Flavor 84 could not be found. Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: action_args: {'id': '84'} Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:01:30.181472 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:30.182514 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:30.184039 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-86dc4b43-c081-4430-8ad0-69680cf21454 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:01:30.185509 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-86dc4b43-c081-4430-8ad0-69680cf21454 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013780 Aug 01 14:01:30.185509 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Mon Aug 1 14:01:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:01:31.209611 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-ab6eb5cc-991d-479d-9d22-7e3e44a3d1a5 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:31.211256 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-ab6eb5cc-991d-479d-9d22-7e3e44a3d1a5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Aug 01 14:01:31.211885 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:01:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:31.773700 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-35a733c8-448b-4217-94c4-d38bac4b77a6 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:31.780680 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.wsgi [None req-35a733c8-448b-4217-94c4-d38bac4b77a6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-35a733c8-448b-4217-94c4-d38bac4b77a6 admin admin] Request method failure captured: Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Accept: application/json Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Accept-Encoding: gzip, deflate Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Connection: keep-alive Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Content-Length: 0 Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Host: 10.222.0.45 Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Openstack-Api-Version: compute 2.90 Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Openstack-System-Scope: None Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: User-Agent: python-novaclient Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Auth-Token: gAAAAABi59y7Ip_o8MVY1nFBDkp2weybOYAF6T_Ef0w7FxW2q4a5QxQVkJ427R6iX-wb21Eap7J8rGZEhAJ0utEQplqwmZSOdh1o1oYUrdFX7TIfEVDSM1ZrvCkdy_G8oy06buLOpfVt40glKYGbc-MxTC32yziJGgg4q7rOmu5nQ1X3sAeUwZQ Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Domain-Id: None Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Domain-Name: None Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Identity-Status: Confirmed Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Is-Admin-Project: True Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Domain-Id: default Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Domain-Name: Default Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Project-Name: admin Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Role: reader,member,admin Aug 01 14:01:31.782942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Roles: reader,member,admin Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a12613c4ac44ad788edb767368b347b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a12613c4ac44ad788edb767368b347b"}]}] Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Tenant: admin Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Tenant-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-Tenant-Name: admin Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User: admin Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Domain-Id: default Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Domain-Name: Default Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Id: bf301c0e8be34b7fa129e68f7514a379 Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: X-User-Name: admin Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: method: > Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: exception: Flavor 451 could not be found. Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: action_args: {'id': '451'} Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:01:31.784711 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:31.785605 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.786985 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-35a733c8-448b-4217-94c4-d38bac4b77a6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:01:31.788385 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-35a733c8-448b-4217-94c4-d38bac4b77a6 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.435964 Aug 01 14:01:31.788385 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 14:01:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:01:31.798179 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-50a3524a-8764-4e3c-bccb-6e98c698570a admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:31.820613 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-50a3524a-8764-4e3c-bccb-6e98c698570a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028887 Aug 01 14:01:31.821184 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 14:01:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:01:31.833962 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:31.850407 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022173 Aug 01 14:01:31.850977 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 14:01:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:01:31.861088 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-02c8e46b-85f1-4daf-b85b-ed7f57432be9 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:31.867608 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.wsgi [None req-02c8e46b-85f1-4daf-b85b-ed7f57432be9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-02c8e46b-85f1-4daf-b85b-ed7f57432be9 admin admin] Request method failure captured: Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Accept: application/json Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Accept-Encoding: gzip, deflate Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Connection: keep-alive Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Content-Length: 0 Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Host: 10.222.0.45 Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Openstack-Api-Version: compute 2.90 Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Openstack-System-Scope: None Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: User-Agent: python-novaclient Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Auth-Token: gAAAAABi59y7Ip_o8MVY1nFBDkp2weybOYAF6T_Ef0w7FxW2q4a5QxQVkJ427R6iX-wb21Eap7J8rGZEhAJ0utEQplqwmZSOdh1o1oYUrdFX7TIfEVDSM1ZrvCkdy_G8oy06buLOpfVt40glKYGbc-MxTC32yziJGgg4q7rOmu5nQ1X3sAeUwZQ Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Domain-Id: None Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Domain-Name: None Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Identity-Status: Confirmed Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Is-Admin-Project: True Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Domain-Id: default Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Domain-Name: Default Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Project-Name: admin Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Role: reader,member,admin Aug 01 14:01:31.876007 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Roles: reader,member,admin Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a12613c4ac44ad788edb767368b347b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a12613c4ac44ad788edb767368b347b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a12613c4ac44ad788edb767368b347b"}]}] Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Tenant: admin Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Tenant-Id: 2a12613c4ac44ad788edb767368b347b Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-Tenant-Name: admin Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User: admin Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Domain-Id: default Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Domain-Name: Default Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Id: bf301c0e8be34b7fa129e68f7514a379 Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: X-User-Name: admin Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: method: > Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: exception: Flavor 451 could not be found. Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: action_args: {'id': '451'} Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:01:31.877640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:31.878639 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: ERROR nova.api.openstack.wsgi Aug 01 14:01:31.880046 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-02c8e46b-85f1-4daf-b85b-ed7f57432be9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:01:31.881339 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-02c8e46b-85f1-4daf-b85b-ed7f57432be9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.020238 Aug 01 14:01:31.881339 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 14:01:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:01:32.920306 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:32.921374 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 01 14:01:32.921769 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:33.515805 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-fcbe2433-b77c-45bd-a399-641ee331554b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:33.545031 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-fcbe2433-b77c-45bd-a399-641ee331554b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.485389 Aug 01 14:01:33.545599 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Mon Aug 1 14:01:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:34.637506 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:34.638525 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 01 14:01:34.638929 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:01:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:35.392080 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-03e4de4b-ab93-46f7-9743-fa0e85e34cd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:35.418078 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-03e4de4b-ab93-46f7-9743-fa0e85e34cd8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.614976 Aug 01 14:01:35.418780 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Mon Aug 1 14:01:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:36.444851 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:36.445880 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 01 14:01:36.446277 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:37.024882 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-67e37dd9-73d9-456a-ae48-85927e9431d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:37.049253 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-67e37dd9-73d9-456a-ae48-85927e9431d3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.457286 Aug 01 14:01:37.049827 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Mon Aug 1 14:01:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:38.052454 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:38.053510 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 01 14:01:38.053876 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:38.687528 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-b8522177-7a3f-41cc-be0d-c020a74ea260 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:38.715864 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-b8522177-7a3f-41cc-be0d-c020a74ea260 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.520985 Aug 01 14:01:38.716892 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Mon Aug 1 14:01:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:39.771580 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:39.773330 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Aug 01 14:01:39.773799 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:01:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:40.450539 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-fdb7e514-d8be-4730-97ff-ef847031d0df admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:40.472300 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-fdb7e514-d8be-4730-97ff-ef847031d0df admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.467177 Aug 01 14:01:40.472879 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Mon Aug 1 14:01:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:02:33.702155 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:33.703172 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-970a793a-4e94-4542-ba12-af9d79f28e16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 01 14:02:33.703567 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 14:02:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:33.714643 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:34.137446 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-a5b69a9f-b118-4074-a434-80907689bf1f admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:34.161094 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-a5b69a9f-b118-4074-a434-80907689bf1f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.450972 Aug 01 14:02:34.161862 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Mon Aug 1 14:02:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:02:34.183255 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG dbcounter [-] [103566] Writing DB stats nova_api:SELECT=14 {{(pid=103566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:34.187009 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-15d2a8e3-00a3-45d4-b720-9630682ceb8b admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:34.194942 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-15d2a8e3-00a3-45d4-b720-9630682ceb8b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013139 Aug 01 14:02:34.195504 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Mon Aug 1 14:02:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:02:34.208072 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-16d83cf4-907f-44c4-89d1-46cf1ca29a14 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:34.216381 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-16d83cf4-907f-44c4-89d1-46cf1ca29a14 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012038 Aug 01 14:02:34.216916 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Mon Aug 1 14:02:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:02:34.229257 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:34.237455 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011961 Aug 01 14:02:34.237984 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Mon Aug 1 14:02:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:02:34.251844 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-bcea9684-f3e6-4a72-9360-ead6ebc7046f admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:34.260528 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-bcea9684-f3e6-4a72-9360-ead6ebc7046f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012204 Aug 01 14:02:34.261094 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Mon Aug 1 14:02:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:06:14.266691 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:14.267845 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Aug 01 14:06:14.268311 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:06:14.413214 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_api:SELECT=6 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:06:14.605739 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-e7bbfebc-6d99-44a1-970e-9f8da3786148 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:14.608241 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:06:14.608241 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: warnings.warn(msg) Aug 01 14:06:14.609566 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-e7bbfebc-6d99-44a1-970e-9f8da3786148 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:14.609999 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-e7bbfebc-6d99-44a1-970e-9f8da3786148 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:14.610790 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-e7bbfebc-6d99-44a1-970e-9f8da3786148 admin admin] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:14.611219 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-e7bbfebc-6d99-44a1-970e-9f8da3786148 admin admin] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:14.646120 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-e7bbfebc-6d99-44a1-970e-9f8da3786148 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.234416 Aug 01 14:06:14.646701 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 14:06:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:06:15.552424 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:15.553455 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 01 14:06:15.553851 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:06:15.762448 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-13b2e286-2a0b-42db-b3d3-03fc97a79592 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:15.765321 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:06:15.765321 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: warnings.warn(msg) Aug 01 14:06:15.766642 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-13b2e286-2a0b-42db-b3d3-03fc97a79592 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:15.767114 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-13b2e286-2a0b-42db-b3d3-03fc97a79592 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:15.768020 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-13b2e286-2a0b-42db-b3d3-03fc97a79592 admin admin] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:15.768481 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-13b2e286-2a0b-42db-b3d3-03fc97a79592 admin admin] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:15.789409 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-13b2e286-2a0b-42db-b3d3-03fc97a79592 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.090287 Aug 01 14:06:15.790273 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 14:06:15 2022] GET /compute/v2.1/os-services => generated 794 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:06:27.075091 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:27.076144 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 01 14:06:27.076604 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:06:27.219239 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_cell0:SELECT=4 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:06:27.221248 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_cell1:SELECT=4 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:06:27.221421 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG dbcounter [-] [103567] Writing DB stats nova_api:SELECT=8 {{(pid=103567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:06:27.282128 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-40a7d0ea-b942-4d70-9cb5-aebb58bfba74 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:27.284531 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:06:27.284531 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: warnings.warn(msg) Aug 01 14:06:27.285725 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-40a7d0ea-b942-4d70-9cb5-aebb58bfba74 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:27.286183 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-40a7d0ea-b942-4d70-9cb5-aebb58bfba74 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:27.286974 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-40a7d0ea-b942-4d70-9cb5-aebb58bfba74 admin admin] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:27.287397 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-40a7d0ea-b942-4d70-9cb5-aebb58bfba74 admin admin] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:27.312322 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-40a7d0ea-b942-4d70-9cb5-aebb58bfba74 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.099460 Aug 01 14:06:27.312873 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 14:06:27 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:06:28.142351 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: DEBUG nova.api.openstack.wsgi [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] Calling method '>' {{(pid=103566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:28.143539 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: INFO nova.api.openstack.requestlog [None req-f7e0f34d-3765-4711-b803-c91b1d7f1479 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001784 Aug 01 14:06:28.144090 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: [pid: 103566|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 14:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:06:28.348430 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG nova.api.openstack.wsgi [None req-3bd5350a-a612-4f79-a2f7-5ae65aea7877 admin admin] Calling method '>' {{(pid=103567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:28.350799 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:06:28.350799 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: warnings.warn(msg) Aug 01 14:06:28.351987 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-3bd5350a-a612-4f79-a2f7-5ae65aea7877 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:28.352450 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-3bd5350a-a612-4f79-a2f7-5ae65aea7877 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:28.353203 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-3bd5350a-a612-4f79-a2f7-5ae65aea7877 admin admin] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:28.353640 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: DEBUG oslo_concurrency.lockutils [None req-3bd5350a-a612-4f79-a2f7-5ae65aea7877 admin admin] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:28.377041 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: INFO nova.api.openstack.requestlog [None req-3bd5350a-a612-4f79-a2f7-5ae65aea7877 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.089799 Aug 01 14:06:28.377604 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: [pid: 103567|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 14:06:28 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:07:26.637924 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: Mon Aug 1 14:07:26 2022 - graceful shutdown triggered... Aug 01 14:07:26.638182 dv-cinder-845178-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 14:07:26.638948 dv-cinder-845178-10-iscsi devstack@n-api.service[103566]: Gracefully killing worker 1 (pid: 103566)... Aug 01 14:07:26.639317 dv-cinder-845178-10-iscsi devstack@n-api.service[103567]: Gracefully killing worker 2 (pid: 103567)... Aug 01 14:07:27.639743 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: worker 1 buried after 1 seconds Aug 01 14:07:27.639743 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: worker 2 buried after 1 seconds Aug 01 14:07:27.639743 dv-cinder-845178-10-iscsi devstack@n-api.service[103565]: goodbye to uWSGI. Aug 01 14:07:27.641502 dv-cinder-845178-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 14:07:27.642095 dv-cinder-845178-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 14:07:27.645129 dv-cinder-845178-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 14:07:27.656211 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 14:07:27 2022] *** Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: nodename: dv-cinder-845178-10-iscsi Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: machine: x86_64 Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: clock source: unix Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: pcre jit disabled Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: detected number of CPU cores: 4 Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: current working directory: / Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: detected binary path: /usr/bin/uwsgi-core Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: your processes number limit is 47680 Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: your memory page size is 4096 bytes Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: detected max file descriptor number: 2048 Aug 01 14:07:27.658355 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: lock engine: pthread robust mutexes Aug 01 14:07:27.659634 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: thunder lock: enabled Aug 01 14:07:27.659634 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 14:07:27.659634 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 14:07:27.699008 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: Python main interpreter initialized at 0x5647facf49c0 Aug 01 14:07:27.699008 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: python threads support enabled Aug 01 14:07:27.699008 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: your server socket listen backlog is limited to 100 connections Aug 01 14:07:27.699008 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: your mercy for graceful operations on workers is 90 seconds Aug 01 14:07:27.699541 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 14:07:27.699541 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: *** Operational MODE: preforking *** Aug 01 14:07:27.699755 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: *** uWSGI is running in multiple interpreter mode *** Aug 01 14:07:27.699755 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: spawned uWSGI master process (pid: 118095) Aug 01 14:07:27.699963 dv-cinder-845178-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 14:07:27.701556 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: spawned uWSGI worker 1 (pid: 118110, cores: 1) Aug 01 14:07:27.701556 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: spawned uWSGI worker 2 (pid: 118111, cores: 1) Aug 01 14:07:27.701796 dv-cinder-845178-10-iscsi devstack@n-api.service[118095]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 14:07:28.364949 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:07:28.371284 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:07:29.545117 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:07:29.545117 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: from cryptography.utils import int_from_bytes Aug 01 14:07:29.546175 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:07:29.546175 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: from cryptography.utils import int_from_bytes Aug 01 14:07:29.598973 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:07:29.598973 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: from cryptography.utils import int_from_bytes Aug 01 14:07:29.599625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:07:29.599625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: from cryptography.utils import int_from_bytes Aug 01 14:07:31.961462 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:07:31.962190 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:07:31.962290 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:07:31.962604 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:07:31.962856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:07:31.963257 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.963578 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.963899 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.964213 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.964574 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.964880 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.965202 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.965514 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.965843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.966096 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.966406 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.966727 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-10-iscsi {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.967043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.967346 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.967648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.967971 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.968306 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.969229 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.969229 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.969434 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.971065 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.971065 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.971065 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.971065 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.971065 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.971537 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.971663 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.971977 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.972314 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.972627 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.973051 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-10-iscsi {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.973363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.973652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.973961 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.974380 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.974688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.974992 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.975355 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.975625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.975926 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.976248 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.976594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.976913 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.977224 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.977521 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.977824 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.978128 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.978441 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.978742 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.979120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.979307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.979628 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.980106 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.980456 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.981110 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.981575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.982042 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.982578 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.982973 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.983355 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.983734 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.984113 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.984511 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.984937 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.985279 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.985651 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.986024 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.986409 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.986787 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.987237 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.987629 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.988015 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.988512 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.988829 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.989201 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.989607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.990018 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.990397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.990779 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.991162 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.992177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.992177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.992177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.992661 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.993031 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.993354 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:07:31.993836 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.993836 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.994107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:07:31.994238 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.994376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:07:31.994505 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.994640 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:07:31.994769 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:07:31.994966 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.995110 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.995389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.995536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.995864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.996021 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.996151 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.996304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.996447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.996676 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.996808 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.997072 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.997203 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.997393 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.997527 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.997725 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.997941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.998090 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.998286 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.998427 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.998612 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-10-iscsi {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.998825 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.998974 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.999245 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.999378 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.999665 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:31.999807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.000006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.000151 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.000339 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.000558 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.000706 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.000963 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.001103 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.001428 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.001566 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.002526 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.002668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.002800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.002938 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.003092 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.003340 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.003472 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.003715 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.003849 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.003849 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.004111 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.004247 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.004418 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.004555 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.004683 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.004817 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.004817 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.005058 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.005193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-10-iscsi {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.005341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.005468 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.005601 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.005734 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.005871 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.006130 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.006270 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.006550 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.006689 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.006873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.007011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.007195 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.007426 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.007567 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.007824 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.007962 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.008153 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.008321 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.008504 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.008733 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.008872 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.009137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.009274 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.009439 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.009603 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.009734 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.010017 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.010160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.010351 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.010488 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.010657 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.010891 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.011030 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.011198 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.011354 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.011508 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.011769 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.012569 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.012718 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.012855 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.012982 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.013110 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.013110 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.013384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.013632 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.013632 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.014007 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.014136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.014274 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.014413 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.014548 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.014675 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.014675 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.014923 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.015050 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.015192 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.015320 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.015447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.015668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.015805 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.015978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.016154 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.016340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.016622 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.016759 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.016948 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.017197 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.017337 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.017639 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.017917 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.018048 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.018316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.018652 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.018784 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.018997 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.019319 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.019519 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.019651 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.019936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.020240 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.020407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.020582 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.020889 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.021028 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.021196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.021516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.021646 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.021854 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.022650 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.022808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.022947 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.022947 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.023198 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.023329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.023456 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.023733 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.023897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.024141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.024291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.024421 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.024658 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.024969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.025102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.025276 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.025584 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.026132 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.026265 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.026554 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.026863 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.027005 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.027171 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.027478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.027655 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.027795 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.028094 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.028387 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.028536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.028738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.029046 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.029177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.029355 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.029664 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.029882 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.030016 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.030283 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.030591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.030729 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.030915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.031222 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.031361 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.031527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.031788 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.031920 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.032152 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.032931 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.033077 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.033207 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.033343 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.033343 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.033622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.033760 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.033760 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.034169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.034414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.034414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.034678 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.034808 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.034936 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.035071 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.035208 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.035398 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.035540 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.035752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.035891 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.036056 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.036344 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.036499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.036683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.036857 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.036998 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.037290 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.037424 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.037601 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.037776 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.037916 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.038214 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:32.038352 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.038554 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.038707 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.038889 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.039137 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.039269 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.039604 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.039754 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.039901 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.040034 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.040212 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.040493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.040632 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.040837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.041010 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.041140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.041399 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.041540 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.041771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.041938 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.042079 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.043061 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.043234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.043234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.043501 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.043629 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.043773 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.043910 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.044064 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.044572 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.044572 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.044906 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.045074 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.045207 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.045343 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.045472 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.045599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.045736 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.045865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.045865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.046108 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.046243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.046243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.046494 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.046631 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.046760 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.046888 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.047097 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.047230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.047514 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.047653 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.047795 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.048009 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.048141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.048352 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.048485 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.048680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.048937 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.049076 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.049318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.049458 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.049741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.049877 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.050059 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.050260 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.050392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.050672 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.050814 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.050996 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.051142 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.051292 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.051553 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.051784 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.051981 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.052159 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.052424 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.052941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.053381 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.053381 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.053640 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.053777 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.053914 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.054043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.054422 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.056156 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.056319 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.056448 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.056572 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.056694 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.056825 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.056939 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.057051 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.057162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.057162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.057162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.057162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.057162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.058640 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.058640 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.058640 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.059021 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.059163 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.059293 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.059430 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.059570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.059707 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.059845 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.059973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.060108 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.060403 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.060558 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.060853 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.060995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.061291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.061567 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.061728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.065038 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.065299 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.065461 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.065582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.065698 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.065811 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.065942 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.066072 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.066353 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.066490 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.066605 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.066725 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.066838 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.066959 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.066959 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067180 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067292 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067403 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067523 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.067645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.069060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.069060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.069060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.069060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.069834 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.070044 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.070044 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.070318 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.070449 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.070449 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.070720 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.070851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.070990 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.071139 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.071139 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.071385 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.071523 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.071523 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.071775 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.071913 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.071913 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.072158 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.072325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.072514 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.072786 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.072937 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.073117 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.073386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.073529 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.073716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.073885 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.074067 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.074337 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.074503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.075468 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.075604 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.075733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.075861 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.075990 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.076133 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.076265 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.076575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.076709 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.076709 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.076953 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.077091 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.077091 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.077362 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.077489 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.077625 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.077803 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.078117 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.078262 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.078438 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.078751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.078971 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.079120 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.079480 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.080554 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.080704 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.080864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.081038 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.081179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.081318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.081318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.081621 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.081829 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.081829 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.082239 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.082435 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.082658 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.082873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.083012 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.083141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.083141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.083411 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.083551 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.083551 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.083934 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.084171 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.084710 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.085776 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.085922 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.086060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.086190 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.086330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.086460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.086611 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.086872 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.087006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.087144 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.087289 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.087427 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.087557 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.087557 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.087816 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.087945 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.087945 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.088398 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.088581 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.088718 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.088848 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.088848 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.089116 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.089253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.089392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.089520 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.089520 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.089787 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.089927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.089927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.090179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.090312 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.090312 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.090638 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.090801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.091003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.091208 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.091208 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.091660 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.091883 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.092100 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.092412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.092412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.092738 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.092885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.092885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.093134 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.093262 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.093397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.093526 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.093526 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.093786 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.093923 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.093923 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.094176 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.094314 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.094453 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.094720 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.094863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.096256 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.096444 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.096594 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.096737 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.096892 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.097158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.097290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.097290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.097290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.097667 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.097796 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.097796 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.098036 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.098290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.098550 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.098689 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.098946 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.099081 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.099389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.099532 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.099890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.100165 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.100394 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.100662 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.100805 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.101167 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.101543 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.101831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.102946 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.103147 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.103421 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.103559 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.103704 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.103835 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.103980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.104159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.104323 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.104526 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.104681 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.104853 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.104988 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.105125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.105279 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.105781 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.106257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.106536 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.106669 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.106799 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.106799 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.107052 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.107184 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.107312 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.107595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.107740 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.107869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.108025 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.108163 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.108316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.108449 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.108717 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.108865 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.109004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.109326 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.109559 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.109774 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.109961 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.110245 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.110442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.110680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.110837 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.111128 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.111330 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.111575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.111763 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.111978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.112257 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.112451 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.112718 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.112923 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.113066 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.113275 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.113476 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.113628 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.113763 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.113895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.114156 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.114343 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.114498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.114643 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.114775 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.115067 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.115266 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.115425 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.115908 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.116100 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.116968 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.117184 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.117394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.117661 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.118043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.118247 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.118465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.118697 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.118697 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.119203 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.119392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.119583 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.119759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.119759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.120065 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.120255 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.120499 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.120729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.120866 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.121004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.121004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.121269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.121407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.121546 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.121546 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.121546 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.121963 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.121963 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.122212 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.122342 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.122342 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.122619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.122757 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.122894 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.123022 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.123022 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.123282 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.123420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.123549 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.123677 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.123805 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.123976 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.124112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.124437 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.124605 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.124749 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.124888 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.125027 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.125302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.125520 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.126219 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.126671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.126671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.126671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.127122 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.127330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.127568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.127787 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.128033 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.128446 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.128652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.128881 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.129233 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.129440 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.129440 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.129949 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.130169 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.130314 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.130455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.130595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.130737 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.130737 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.130983 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.131121 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.131251 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.131379 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.131379 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.131634 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.131764 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.131892 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.132019 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.132156 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.132355 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.132487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.132752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.132902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.133080 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.133263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.133399 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.133686 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.133830 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.133997 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.134189 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.134339 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.134607 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.134741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.134916 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.135134 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.135269 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.135518 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.135652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.135825 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.135989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.136465 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.136785 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.136989 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.136989 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.137388 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.137615 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.137836 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.138159 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.138402 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.138732 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.138732 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.139066 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.139066 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.139066 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.139679 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.139884 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.140088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.140088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.140493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.140648 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.140791 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.140922 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.141061 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.141202 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.141342 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.141473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.141473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.141735 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.141864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.141864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.142119 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.142250 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.142389 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.142526 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.142664 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.142856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.143013 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.143252 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.143471 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.143626 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.143827 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.143973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.144237 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.144452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.144596 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.144791 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.144951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.145210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.145348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.145535 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.145700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.145842 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.146075 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.146241 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.146677 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.146939 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.147082 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.147213 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.147342 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.147483 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.147613 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.147613 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.147858 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.147994 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.148193 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.148385 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.148580 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.148728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.148990 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.149135 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.149273 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.149526 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.149674 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.149805 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.149943 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.150073 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.150357 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.150504 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.151057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.151201 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.151366 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.151581 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.151725 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.151971 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.152111 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.152549 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.152777 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.152923 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.153074 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.153213 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.153352 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.153489 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.153650 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.153794 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.153957 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.154147 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.154292 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.154569 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.154702 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.154884 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.155015 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.155201 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.155431 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.155565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.155850 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.156007 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.156219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.156388 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.156911 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.157244 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.157244 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.157958 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.158109 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.158241 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.158370 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.158370 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.158620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.158760 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.158760 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.159573 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.159980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.160158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.160347 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.160518 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.160679 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.161027 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.161208 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.161369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.161369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.161709 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.161891 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.162023 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.162137 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.162436 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.162864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.163051 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.163210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.163351 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.163602 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.163754 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.164075 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.164486 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.164633 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.164765 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.164878 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.165007 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.165159 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.165500 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.165645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.165840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.166079 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.166314 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.166507 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.166640 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.167145 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.167428 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.167586 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.167734 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.167866 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.168003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.168003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.168256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.168425 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.168615 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.168797 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.169045 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.169383 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.169526 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.169848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.170238 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.170622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.170977 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.171110 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.171343 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.171487 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.171809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.171939 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.172152 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.172305 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.172596 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.172885 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.173145 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.173278 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.173407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.173545 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.173683 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.173828 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.173969 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.174099 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.174394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.174599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.174841 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.175029 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.175175 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.175384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.175516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.175707 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.175849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.176027 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.176329 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.176479 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.176669 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.176807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.176962 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.177439 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.177680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.177821 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.177960 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.177960 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.178214 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.178343 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.178470 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.178605 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.178845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.178987 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.179155 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.179322 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.179598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.179730 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.179873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.180159 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.181049 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.181198 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.181338 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.181469 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.181606 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.181735 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.181872 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.182011 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.182011 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.182259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.182387 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.182523 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.182667 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.182934 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.183072 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.183358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.183492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.183622 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.183767 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.183898 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.184154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.184931 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.185075 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.185208 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.185360 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.185492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.186240 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.186240 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.186503 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.186640 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.186781 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.186923 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.187054 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.187198 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.187669 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.187922 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.187922 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.188180 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.188341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.188341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.188605 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.188605 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.188870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.188870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.189124 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.189261 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.189261 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.189516 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.189800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.189941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.190073 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.190073 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.190474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.190621 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.190621 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.190873 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.191010 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.191141 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.191281 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.191281 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.191526 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.191661 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.191835 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.192034 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.192177 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.192488 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.192623 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.193140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.193298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.193298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.193714 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.193714 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.193961 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.194100 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.194230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.194527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.194849 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.194985 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.195171 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.195543 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.195656 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.195950 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.196095 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.196492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.196622 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.196828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.196959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.197162 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.197258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.197486 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.197587 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.197805 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.197898 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.198118 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.198211 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.198439 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.198539 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.198756 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.198851 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.199073 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.199166 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.199385 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.199477 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.199700 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.199864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.200036 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.200131 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.200390 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.200500 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.200723 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.200833 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.201071 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.201166 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.201375 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.201468 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.201682 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.201785 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.201992 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.202095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.202299 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.202404 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.202605 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.202699 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.202927 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.203019 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.203237 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.203374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.203547 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.203681 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.204018 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.204143 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.204255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.204406 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.204557 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.204690 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.204819 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.204947 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.205075 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.205214 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.205344 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.205479 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.205680 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.205857 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.206024 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.206171 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.206356 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.206612 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.206800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.206980 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.207160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.207309 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.207571 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.207739 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.207864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.208169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.208399 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.208535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.208826 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.208960 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.209128 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.209402 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.209545 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.209761 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.209892 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.210090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.210229 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.210397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.210682 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.210825 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.211007 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.211148 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.211337 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.211550 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.211701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.211957 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.212089 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.212260 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.212414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.212570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.212789 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.212949 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.213166 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.213327 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.213553 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.213754 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.214059 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.214360 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.214668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.214915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.215043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.215291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.215442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.215586 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.215743 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.215904 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.216092 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.216224 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.216454 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.216578 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.216783 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.216904 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.217082 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.217199 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.217428 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.217548 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.217829 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.217956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.218078 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.218199 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.218366 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.218485 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.218683 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.218959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.219094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.219300 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.219426 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.219620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.219747 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.219936 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.220069 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.220248 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.220401 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.220591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.220761 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.220950 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.221044 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.221222 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.221418 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.221560 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.221722 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.221851 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.222037 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.222156 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.222363 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.222493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.222682 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.222822 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.222992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.223131 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.223305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.223607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.223758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.223881 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.224012 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.224190 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.224342 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.224526 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.224673 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.224856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.224986 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.225206 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.225412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.225547 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.225722 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.225898 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.226056 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.226188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.226317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.226453 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.226593 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.226707 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.226933 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.227167 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.227302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.227441 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.227571 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.227744 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.227922 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.228054 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.228193 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.228383 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.228508 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.228701 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.228896 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.229084 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.229217 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.229404 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.229535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.229724 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.229844 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.230030 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.230152 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.230340 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.230446 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.230652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.230763 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.230960 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.231181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.231283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.231389 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.231680 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.231857 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.232001 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.232142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.232294 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.232428 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.232577 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.232708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.232838 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.233011 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.233146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.233330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.233472 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.233689 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.233809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.234107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.234227 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.234318 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.234598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.234703 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.234917 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.235087 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.235229 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.235359 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.235580 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.235747 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.235914 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.236056 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.236229 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.236394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.236565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.236714 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.236876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.237053 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.237279 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.237414 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.237579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.237723 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.237893 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.238043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.238209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.238351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.238525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.238673 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.238822 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.238960 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.239137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.239271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.239451 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.239592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.239763 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.239895 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.240066 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.240206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.240389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.240542 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.240679 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.240818 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.240986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.241241 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.241488 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.241628 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.241748 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.241868 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.241992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.242143 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.242290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.242465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.242598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.242786 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.242928 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.243100 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.243235 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.243400 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.243540 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.243717 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.243953 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.244099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.244238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.244398 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.244540 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.244678 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.244817 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.244955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.245093 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.245221 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.245356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.245500 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.245648 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.245778 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.245914 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.246043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.246320 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.246461 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.246630 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.246762 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.246929 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.247062 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.247305 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.247464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.247604 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.247740 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.247901 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.248074 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.248206 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.248430 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.248592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.248725 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.249014 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.249315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.249548 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.249723 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.249903 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.250054 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.250196 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.250345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.250487 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.250639 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.250793 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.250937 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.251087 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.251265 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.251514 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.251758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.251908 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.252062 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.252205 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.252390 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.252536 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.252725 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.252874 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.253016 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.253158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.253299 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.253452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.253594 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.253744 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.253894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.254163 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.254312 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.254465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.254609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.254753 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.254902 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.255046 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.255179 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.255314 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.255452 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.255565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.255701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.255839 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.256034 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.256177 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.256381 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.256529 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.256690 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.256996 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.257303 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.257773 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.257909 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.258044 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.258215 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.258338 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.258473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.258592 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.258694 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.258901 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.258996 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.259209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.259311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.259514 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.259607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.259857 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.259956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.260158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.260254 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.260500 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.260638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.260810 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.260951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.261153 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.261286 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.261415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.261648 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.261882 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.262016 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.262159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.262307 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.262436 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.262563 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.262700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.262839 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.262981 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.263111 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.263238 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.263365 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.263492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.263629 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.263765 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.263903 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.264095 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.264347 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.264467 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.264589 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.264751 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.264870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.265179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.265323 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.265442 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.265564 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.265684 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.265801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.265992 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.266134 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.266301 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.266435 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.266607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.268140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.268382 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.268535 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.268674 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.268818 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.268956 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.269087 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.269216 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.269351 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.269351 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.269607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.269607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.269858 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.269996 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.270141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.270278 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.270407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.270544 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.270674 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.270807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.270951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.271089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.271220 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.271357 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.271493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.271646 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.271882 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.272016 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.272144 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.272290 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.272420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.272567 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.272697 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.272826 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.272954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.273091 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.273235 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.273379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.273509 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.273637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.273766 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.273933 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.274071 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.274215 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.274447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.274588 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.274725 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.274848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.274977 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.275105 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.275243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.275368 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.275496 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.275621 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.276084 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:07:32.276220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.276220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.276220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.276625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.276758 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.276988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.277291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.277592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.277881 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.278178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.278476 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.278779 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.279076 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.279374 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.279689 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.279970 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.280384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.280632 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.280962 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.281269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.281588 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.281914 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.282996 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.282996 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.282996 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.283417 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.283417 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.283717 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.284991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.284991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.284991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.284991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.285443 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.285595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.285901 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.286233 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.286554 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.286858 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.287184 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.287499 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.287816 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.288126 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.288986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.288986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.289298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.289452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.289665 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.289973 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.290283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.290592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.290899 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.291215 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.291521 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.291831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.292163 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.292516 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.292823 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.293144 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.293467 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.293813 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.294122 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.294465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.294791 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.295081 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.295394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.295693 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:32.296427 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:07:32.344565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO dbcounter [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Registered counter for database nova_api Aug 01 14:07:32.367292 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_db.sqlalchemy.engines [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:32.377855 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writer thread running {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:32.441962 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.context [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b931c80f-59a5-40eb-8557-eb4bfa964b56(cell1) {{(pid=118111) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:07:32.446529 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:07:32.448597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:07:32.449459 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:07:32.452144 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:07:32.455230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO dbcounter [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Registered counter for database nova_cell0 Aug 01 14:07:32.461079 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO dbcounter [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Registered counter for database nova_api Aug 01 14:07:32.461334 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO dbcounter [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Registered counter for database nova_cell1 Aug 01 14:07:32.469725 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_db.sqlalchemy.engines [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:32.474785 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_db.sqlalchemy.engines [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:32.482242 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writer thread running {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:32.482645 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_db.sqlalchemy.engines [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:32.485800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writer thread running {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:32.494934 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writer thread running {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:32.559616 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.context [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b931c80f-59a5-40eb-8557-eb4bfa964b56(cell1) {{(pid=118110) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:07:32.563877 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:07:32.565569 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:07:32.566534 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:07:32.570230 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:07:32.572325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO dbcounter [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Registered counter for database nova_cell0 Aug 01 14:07:32.577300 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO dbcounter [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Registered counter for database nova_cell1 Aug 01 14:07:32.585843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_db.sqlalchemy.engines [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:32.590369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_db.sqlalchemy.engines [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:32.595608 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writer thread running {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:32.598678 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writer thread running {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:32.647487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO dbcounter [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Registered counter for database nova_cell0 Aug 01 14:07:32.655506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_db.sqlalchemy.engines [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:32.660826 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writer thread running {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:32.750752 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO dbcounter [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Registered counter for database nova_cell0 Aug 01 14:07:32.762158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_db.sqlalchemy.engines [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:32.768175 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writer thread running {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:33.004351 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: WARNING keystonemiddleware.auth_token [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:07:33.012113 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: WARNING keystonemiddleware.auth_token [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:07:33.098299 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: WARNING keystonemiddleware.auth_token [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:07:33.106818 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: WARNING keystonemiddleware.auth_token [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:07:33.366491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: WARNING keystonemiddleware.auth_token [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:07:33.372970 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: WARNING keystonemiddleware.auth_token [None req-ab0d35d7-19a3-4cf2-8cf7-52dd32586c2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:07:33.378598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647facf49c0 pid: 118111 (default app) Aug 01 14:07:33.466811 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: WARNING keystonemiddleware.auth_token [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:07:33.473262 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: WARNING keystonemiddleware.auth_token [None req-beb4678d-0827-4ccc-9566-967ec4fb56e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:07:33.478713 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647facf49c0 pid: 118110 (default app) Aug 01 14:08:16.204729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.207265 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.208610 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.209828 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.367714 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.377867 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.380460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.381918 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:18.254006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2b869f5d-436f-449b-a96e-f69977dfe10b tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Action: 'create', calling method: .version_select at 0x7fc57b781f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1625884635"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:18.503165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c91bbe1c-a88f-4a97-a90a-de30eec7adff tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Action: 'create', calling method: .version_select at 0x7fc57b7b7e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1301227221", "metadata": {"Type": "work"}}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:20.202873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2b869f5d-436f-449b-a96e-f69977dfe10b tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.019263 Aug 01 14:08:20.204801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Mon Aug 1 14:08:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4025 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 14:08:20.852533 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-47472ecf-f280-4f04-8e37-0118f1a53516 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Action: 'create', calling method: .version_select at 0x7fc57b607d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1342706596", "metadata": {"Type": "work"}}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-47472ecf-f280-4f04-8e37-0118f1a53516 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Request method failure captured: Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 122 Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595Q-R5xpX_oPvmdWDZiHPR23CoSW90hTTaby-HmKfYCCgaaEj3oKlloEwAWVnpjwFWu0jto8AFRGmzrD2OgqZj8RI5U4vFuHRuYd9cvLyXre7YEcf_InkJQSYe5Gw84ugdJGHm7whRW7XtgPMylQcxQ5Fu8GjZlarMb6lrFyF6kSGw Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:08:20.858487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_65fba8ff6b34466b8c456924d9cae36f", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/65fba8ff6b34466b8c456924d9cae36f"}]}] Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: ba5780f4e0374edea061f6f2af11002c Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1342706596", "metadata": {"Type": "work"}}} Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: Aug 01 14:08:20.859561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1342706596', 'metadata': {'Type': 'work'}}}} Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:20.860182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:08:20.861356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:08:20.862326 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:08:20.862326 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:20.866043 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-47472ecf-f280-4f04-8e37-0118f1a53516 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:20.867338 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-47472ecf-f280-4f04-8e37-0118f1a53516 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.661335 Aug 01 14:08:20.869173 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 2/2] 10.222.0.45 () {60 vars in 1156 bytes} [Mon Aug 1 14:08:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 664 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:08:20.879615 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-80397c4f-d04b-4f95-bb35-efcdb0c53492 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b5c1790>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:21.168156 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-80397c4f-d04b-4f95-bb35-efcdb0c53492 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a" status: 200 len: 345 microversion: 2.1 time: 0.297359 Aug 01 14:08:21.169616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 3/3] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:20 2022] GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a => generated 345 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:21.190787 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-23245f1c-353d-43f6-981f-969f1f34f2e2 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Action: 'create', calling method: .version_select at 0x7fc57b618820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1590252698", "metadata": {"Type": "work"}}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-23245f1c-353d-43f6-981f-969f1f34f2e2 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Request method failure captured: Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 120 Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595Q-R5xpX_oPvmdWDZiHPR23CoSW90hTTaby-HmKfYCCgaaEj3oKlloEwAWVnpjwFWu0jto8AFRGmzrD2OgqZj8RI5U4vFuHRuYd9cvLyXre7YEcf_InkJQSYe5Gw84ugdJGHm7whRW7XtgPMylQcxQ5Fu8GjZlarMb6lrFyF6kSGw Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:08:21.194876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_65fba8ff6b34466b8c456924d9cae36f", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/65fba8ff6b34466b8c456924d9cae36f"}]}] Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: ba5780f4e0374edea061f6f2af11002c Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1590252698", "metadata": {"Type": "work"}}} Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: Aug 01 14:08:21.197088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1590252698', 'metadata': {'Type': 'work'}}}} Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi '0' Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:21.197959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:08:21.199154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:08:21.200179 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:08:21.200179 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.200179 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-23245f1c-353d-43f6-981f-969f1f34f2e2 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:21.202149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-23245f1c-353d-43f6-981f-969f1f34f2e2 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030559 Aug 01 14:08:21.203304 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 4/4] 10.222.0.45 () {60 vars in 1156 bytes} [Mon Aug 1 14:08:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:08:21.217231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1405c6b7-be24-47f3-b58b-22043b955f26 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Action: 'create', calling method: .version_select at 0x7fc57b5c1940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1007267789", "metadata": {"Type": "work"}}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1405c6b7-be24-47f3-b58b-22043b955f26 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Request method failure captured: Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 119 Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595Q-R5xpX_oPvmdWDZiHPR23CoSW90hTTaby-HmKfYCCgaaEj3oKlloEwAWVnpjwFWu0jto8AFRGmzrD2OgqZj8RI5U4vFuHRuYd9cvLyXre7YEcf_InkJQSYe5Gw84ugdJGHm7whRW7XtgPMylQcxQ5Fu8GjZlarMb6lrFyF6kSGw Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:08:21.228666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_65fba8ff6b34466b8c456924d9cae36f", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/65fba8ff6b34466b8c456924d9cae36f"}]}] Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: ba5780f4e0374edea061f6f2af11002c Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1007267789", "metadata": {"Type": "work"}}} Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: Aug 01 14:08:21.229742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1007267789', 'metadata': {'Type': 'work'}}}} Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi '' Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:21.230429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:08:21.231499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:08:21.232574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:08:21.232574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.234820 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1405c6b7-be24-47f3-b58b-22043b955f26 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:21.237074 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1405c6b7-be24-47f3-b58b-22043b955f26 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025902 Aug 01 14:08:21.239415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 5/5] 10.222.0.45 () {60 vars in 1156 bytes} [Mon Aug 1 14:08:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 14:08:21.255113 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2df841c1-555f-4d86-b511-4fd170ec258f tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Calling method '.version_select at 0x7fc57bf8c430>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:21.307280 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c91bbe1c-a88f-4a97-a90a-de30eec7adff tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.958775 Aug 01 14:08:21.309536 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 1/6] 10.222.0.45 () {60 vars in 1156 bytes} [Mon Aug 1 14:08:16 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4964 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 01 14:08:21.323596 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-2df841c1-555f-4d86-b511-4fd170ec258f tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] HTTP exception thrown: Volume tempest-invalid-1019685766 could not be found. Aug 01 14:08:21.325658 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f990d230-fa6d-4166-9e2c-979f019b796f tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Calling method '.version_select at 0x7fc57b5bcca0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2df841c1-555f-4d86-b511-4fd170ec258f tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Request method failure captured: Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1019685766 HTTP/1.1 Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595Q-R5xpX_oPvmdWDZiHPR23CoSW90hTTaby-HmKfYCCgaaEj3oKlloEwAWVnpjwFWu0jto8AFRGmzrD2OgqZj8RI5U4vFuHRuYd9cvLyXre7YEcf_InkJQSYe5Gw84ugdJGHm7whRW7XtgPMylQcxQ5Fu8GjZlarMb6lrFyF6kSGw Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:08:21.327794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_65fba8ff6b34466b8c456924d9cae36f", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/65fba8ff6b34466b8c456924d9cae36f"}]}] Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: ba5780f4e0374edea061f6f2af11002c Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Volume tempest-invalid-1019685766 could not be found. Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': 'tempest-invalid-1019685766'} Aug 01 14:08:21.329114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1019685766 could not be found. (HTTP 404) (Request-ID: req-fa9f028f-bff9-4ea5-9a51-95561283e7cf) Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.329905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:08:21.331132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1019685766 could not be found. Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:08:21.332206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1019685766 could not be found. Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1019685766 could not be found. Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2df841c1-555f-4d86-b511-4fd170ec258f tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Returning 404 to user: Volume tempest-invalid-1019685766 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2df841c1-555f-4d86-b511-4fd170ec258f tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1019685766" status: 404 len: 99 microversion: 2.1 time: 0.080688 Aug 01 14:08:21.338142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 6/7] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 14:08:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1019685766 => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 01 14:08:21.343433 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-efd7f839-22a3-4729-8910-dc9f33cfa736 tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006105 Aug 01 14:08:21.343942 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 7/8] 10.222.0.45 () {58 vars in 1140 bytes} [Mon Aug 1 14:08:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 14:08:21.371502 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8981e368-a22e-4c57-b5f2-432bca2e833d tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015651 Aug 01 14:08:21.373306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 8/9] 10.222.0.45 () {58 vars in 1137 bytes} [Mon Aug 1 14:08:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 14:08:21.400626 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fcbdba5e-7fcd-445d-9415-c19fb8946aef tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Calling method '.version_select at 0x7fc57b5e0280>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:21.461638 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f990d230-fa6d-4166-9e2c-979f019b796f tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e" status: 200 len: 353 microversion: 2.1 time: 0.141714 Aug 01 14:08:21.467901 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 2/10] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:21 2022] GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:21.482612 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-fcbdba5e-7fcd-445d-9415-c19fb8946aef tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] HTTP exception thrown: Volume d1223685-dda9-4d91-820e-ebcfc80f0dd9 could not be found. Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fcbdba5e-7fcd-445d-9415-c19fb8946aef tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Request method failure captured: Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/os-volumes/d1223685-dda9-4d91-820e-ebcfc80f0dd9 HTTP/1.1 Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595Q-R5xpX_oPvmdWDZiHPR23CoSW90hTTaby-HmKfYCCgaaEj3oKlloEwAWVnpjwFWu0jto8AFRGmzrD2OgqZj8RI5U4vFuHRuYd9cvLyXre7YEcf_InkJQSYe5Gw84ugdJGHm7whRW7XtgPMylQcxQ5Fu8GjZlarMb6lrFyF6kSGw Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:08:21.484980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_65fba8ff6b34466b8c456924d9cae36f", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/65fba8ff6b34466b8c456924d9cae36f"}]}] Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: ba5780f4e0374edea061f6f2af11002c Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Volume d1223685-dda9-4d91-820e-ebcfc80f0dd9 could not be found. Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': 'd1223685-dda9-4d91-820e-ebcfc80f0dd9'} Aug 01 14:08:21.486004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1223685-dda9-4d91-820e-ebcfc80f0dd9 could not be found. (HTTP 404) (Request-ID: req-87f12ae1-3f31-48d3-9eb4-9e3d29195cb8) Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.486670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:08:21.487692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1223685-dda9-4d91-820e-ebcfc80f0dd9 could not be found. Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:08:21.488568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1223685-dda9-4d91-820e-ebcfc80f0dd9 could not be found. Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1223685-dda9-4d91-820e-ebcfc80f0dd9 could not be found. Aug 01 14:08:21.489503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.492442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fcbdba5e-7fcd-445d-9415-c19fb8946aef tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Returning 404 to user: Volume d1223685-dda9-4d91-820e-ebcfc80f0dd9 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:21.493713 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fcbdba5e-7fcd-445d-9415-c19fb8946aef tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/d1223685-dda9-4d91-820e-ebcfc80f0dd9" status: 404 len: 109 microversion: 2.1 time: 0.112308 Aug 01 14:08:21.499470 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 9/11] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:08:21 2022] DELETE /compute/v2.1/os-volumes/d1223685-dda9-4d91-820e-ebcfc80f0dd9 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:08:21.515322 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8a01faba-0e7e-42db-a24e-9754e4b42b0e tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Calling method '.version_select at 0x7fc57b5ce3a0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:21.580727 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-8a01faba-0e7e-42db-a24e-9754e4b42b0e tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] HTTP exception thrown: Volume 95a73065-87c5-45b2-bb91-c067e2be0168 could not be found. Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8a01faba-0e7e-42db-a24e-9754e4b42b0e tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Request method failure captured: Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/os-volumes/95a73065-87c5-45b2-bb91-c067e2be0168 HTTP/1.1 Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi595Q-R5xpX_oPvmdWDZiHPR23CoSW90hTTaby-HmKfYCCgaaEj3oKlloEwAWVnpjwFWu0jto8AFRGmzrD2OgqZj8RI5U4vFuHRuYd9cvLyXre7YEcf_InkJQSYe5Gw84ugdJGHm7whRW7XtgPMylQcxQ5Fu8GjZlarMb6lrFyF6kSGw Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:08:21.589255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_65fba8ff6b34466b8c456924d9cae36f", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/65fba8ff6b34466b8c456924d9cae36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/65fba8ff6b34466b8c456924d9cae36f"}]}] Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 65fba8ff6b34466b8c456924d9cae36f Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-VolumesNegativeTest-384998390 Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: ba5780f4e0374edea061f6f2af11002c Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-VolumesNegativeTest-384998390-project Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Volume 95a73065-87c5-45b2-bb91-c067e2be0168 could not be found. Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '95a73065-87c5-45b2-bb91-c067e2be0168'} Aug 01 14:08:21.590392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95a73065-87c5-45b2-bb91-c067e2be0168 could not be found. (HTTP 404) (Request-ID: req-daafcdd2-9380-4042-bebb-7ec7c61736fc) Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.591259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:21.592102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95a73065-87c5-45b2-bb91-c067e2be0168 could not be found. Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:08:21.593232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95a73065-87c5-45b2-bb91-c067e2be0168 could not be found. Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95a73065-87c5-45b2-bb91-c067e2be0168 could not be found. Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8a01faba-0e7e-42db-a24e-9754e4b42b0e tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] Returning 404 to user: Volume 95a73065-87c5-45b2-bb91-c067e2be0168 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:21.594283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8a01faba-0e7e-42db-a24e-9754e4b42b0e tempest-VolumesNegativeTest-384998390 tempest-VolumesNegativeTest-384998390-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/95a73065-87c5-45b2-bb91-c067e2be0168" status: 404 len: 109 microversion: 2.1 time: 0.090220 Aug 01 14:08:21.596373 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 3/12] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:21 2022] GET /compute/v2.1/os-volumes/95a73065-87c5-45b2-bb91-c067e2be0168 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:08:22.183079 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ccead3a1-d12f-41ad-b30a-d32229156f29 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b607ee0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:22.294725 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ccead3a1-d12f-41ad-b30a-d32229156f29 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a" status: 200 len: 346 microversion: 2.1 time: 0.115162 Aug 01 14:08:22.310558 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-aac1d311-6438-4816-8dc4-a808c77d95d1 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Action: 'create', calling method: .version_select at 0x7fc57b5b6430>, body: {"snapshot": {"volume_id": "840ebaa7-ac65-4d39-9d45-beb7c3a1973a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1853376850"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:22.312955 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 10/13] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:22 2022] GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a => generated 346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:22.482873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-67c3df90-9fec-4910-ae8e-0df8654bf9a4 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Calling method '.version_select at 0x7fc57b5e0790>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:22.668100 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-67c3df90-9fec-4910-ae8e-0df8654bf9a4 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e" status: 200 len: 354 microversion: 2.1 time: 0.196259 Aug 01 14:08:22.669326 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 11/14] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:22 2022] GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e => generated 354 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:22.684084 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f93881df-8313-4ffe-85a5-187605be16ff tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Calling method '.version_select at 0x7fc57b607e50>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:23.072105 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-aac1d311-6438-4816-8dc4-a808c77d95d1 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.765713 Aug 01 14:08:23.074178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 4/15] 10.222.0.45 () {60 vars in 1162 bytes} [Mon Aug 1 14:08:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:23.088860 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5a00f4c5-dab4-46dd-ac7a-500b5a43f32c tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b53c5e0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:23.202341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f93881df-8313-4ffe-85a5-187605be16ff tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e" status: 200 len: 354 microversion: 2.1 time: 0.524084 Aug 01 14:08:23.203228 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 12/16] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:22 2022] GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e => generated 354 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:23.219731 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-53c72230-495a-4873-991a-1e8506fce94d tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Calling method '.version_select at 0x7fc57b5c1dc0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:23.262128 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5a00f4c5-dab4-46dd-ac7a-500b5a43f32c tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7" status: 200 len: 287 microversion: 2.1 time: 0.178100 Aug 01 14:08:23.262862 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 5/17] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 14:08:23 2022] GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 => generated 287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:23.275078 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-7cfd4dee-0bf4-4ef3-b88f-5c4fa77b2f32 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b5b6ca0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:23.446785 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-53c72230-495a-4873-991a-1e8506fce94d tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e" status: 202 len: 0 microversion: 2.1 time: 0.232860 Aug 01 14:08:23.447657 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 13/18] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:08:23 2022] DELETE /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:08:23.456581 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-06921033-4ef4-401a-8b65-00d98f399783 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Calling method '.version_select at 0x7fc57b5e0160>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:23.626459 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-7cfd4dee-0bf4-4ef3-b88f-5c4fa77b2f32 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.355723 Aug 01 14:08:23.633462 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 6/19] 10.222.0.45 () {58 vars in 1140 bytes} [Mon Aug 1 14:08:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:23.638909 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-43f4a51a-0982-4721-a233-cf84bf345899 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b53c280>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:23.737275 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-06921033-4ef4-401a-8b65-00d98f399783 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e" status: 200 len: 353 microversion: 2.1 time: 0.284503 Aug 01 14:08:23.738683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 14/20] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:23 2022] GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e => generated 353 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:23.845691 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-43f4a51a-0982-4721-a233-cf84bf345899 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7" status: 200 len: 287 microversion: 2.1 time: 0.210723 Aug 01 14:08:23.846329 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 7/21] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 14:08:23 2022] GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 => generated 287 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:24.766234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9267f9d8-ac27-43a5-9879-63ebfe8446b5 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Calling method '.version_select at 0x7fc57b5c15e0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:24.865084 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0ca67adf-2543-4bfc-94a3-cbd4649d4b3e tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b53ce50>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:24.973028 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9267f9d8-ac27-43a5-9879-63ebfe8446b5 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e" status: 200 len: 353 microversion: 2.1 time: 0.212862 Aug 01 14:08:24.975015 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 15/22] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:24 2022] GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e => generated 353 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:25.140700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0ca67adf-2543-4bfc-94a3-cbd4649d4b3e tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7" status: 200 len: 287 microversion: 2.1 time: 0.273378 Aug 01 14:08:25.142203 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 8/23] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 14:08:24 2022] GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 => generated 287 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:26.003314 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f03dc71c-5b70-4b86-b561-b80b703a7124 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Calling method '.version_select at 0x7fc57b5c18b0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:26.093537 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f03dc71c-5b70-4b86-b561-b80b703a7124 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e" status: 200 len: 353 microversion: 2.1 time: 0.103934 Aug 01 14:08:26.106731 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 16/24] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:25 2022] GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:26.155704 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c208e0bd-9ad5-4b26-9cd6-1d29e6d67e3c tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b53cca0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:26.248838 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c208e0bd-9ad5-4b26-9cd6-1d29e6d67e3c tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7" status: 200 len: 287 microversion: 2.1 time: 0.097917 Aug 01 14:08:26.256373 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 9/25] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 14:08:26 2022] GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:27.067803 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-88a32b12-318a-4f02-9699-eb0bcaac14c1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'create', calling method: .version_select at 0x7fc57b5e0940>, body: {"keypair": {"name": "tempest-keypair-1078354145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7K0Ac8nYGFVUGS5XjUoEbh+/41PaIZs/MmF+PX1GROyg2axU5+Fq9DJ5ZQiQJHs+rfCpL5LrRkTEaD+J+H/HlryyJ9TpOuZ+zoAiSqNHvV80de9/2RCuebYl+ngldkXQ=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:27.109855 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d10e5f81-ea0d-475e-bb70-04f71498af38 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Calling method '.version_select at 0x7fc57b53c4c0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:27.255903 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-d10e5f81-ea0d-475e-bb70-04f71498af38 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] HTTP exception thrown: Volume 5031ce2d-a314-4412-9db6-38167655c82e could not be found. Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d10e5f81-ea0d-475e-bb70-04f71498af38 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Request method failure captured: Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e HTTP/1.1 Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi595Q1HPH59yumgjW-wGjIvCbHqBfXv07UVKTqYV1HdlNp63IfnGF25nUjG86ogI9yRWuFuV7FpzzV3ff52egCeJaeX36N-eawzc1eQtFHcZrJV0jxDbB-oNERQKxLEWMhzLQ7FEF53gsGkDkqapcVnU36WizPgYMF_Uf287cQJMN-sQ Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: f209a9617cbe40f394023a7a1ba12b81 Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-VolumesGetTestJSON-578260023 Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:08:27.262379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f209a9617cbe40f394023a7a1ba12b81", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f209a9617cbe40f394023a7a1ba12b81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f209a9617cbe40f394023a7a1ba12b81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f209a9617cbe40f394023a7a1ba12b81"}]}] Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-VolumesGetTestJSON-578260023 Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: f209a9617cbe40f394023a7a1ba12b81 Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-VolumesGetTestJSON-578260023 Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-VolumesGetTestJSON-578260023-project Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 83360ac42cdc4dbabb3016177e523803 Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-VolumesGetTestJSON-578260023-project Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Volume 5031ce2d-a314-4412-9db6-38167655c82e could not be found. Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '5031ce2d-a314-4412-9db6-38167655c82e'} Aug 01 14:08:27.265003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5031ce2d-a314-4412-9db6-38167655c82e could not be found. (HTTP 404) (Request-ID: req-7ce336be-af76-48b1-8a50-5677f03bd71f) Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:27.267011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:27.268848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5031ce2d-a314-4412-9db6-38167655c82e could not be found. Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:08:27.270886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5031ce2d-a314-4412-9db6-38167655c82e could not be found. Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5031ce2d-a314-4412-9db6-38167655c82e could not be found. Aug 01 14:08:27.278188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:08:27.284144 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d10e5f81-ea0d-475e-bb70-04f71498af38 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] Returning 404 to user: Volume 5031ce2d-a314-4412-9db6-38167655c82e could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:27.294630 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d10e5f81-ea0d-475e-bb70-04f71498af38 tempest-VolumesGetTestJSON-578260023 tempest-VolumesGetTestJSON-578260023-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e" status: 404 len: 109 microversion: 2.1 time: 0.190145 Aug 01 14:08:27.302773 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 10/26] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:27 2022] GET /compute/v2.1/os-volumes/5031ce2d-a314-4412-9db6-38167655c82e => generated 109 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:08:27.365418 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-354654f0-0a5c-4121-bd44-9879310d68f4 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b53cee0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:27.380657 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-88a32b12-318a-4f02-9699-eb0bcaac14c1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Getting quotas for project 1081ae5fd3e9443c80626517ae9c7d77. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:08:27.407293 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-88a32b12-318a-4f02-9699-eb0bcaac14c1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Getting quotas for user 87f35e960544403ea30ba36d878a86cb and project 1081ae5fd3e9443c80626517ae9c7d77. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:08:27.544762 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-354654f0-0a5c-4121-bd44-9879310d68f4 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7" status: 200 len: 288 microversion: 2.1 time: 0.228757 Aug 01 14:08:27.559108 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 11/27] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 14:08:27 2022] GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 => generated 288 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:27.587487 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8ce2cf05-9157-41cd-8504-bfbdacda7004 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b53caf0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:27.615708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-88a32b12-318a-4f02-9699-eb0bcaac14c1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.088176 Aug 01 14:08:27.616826 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 17/28] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:08:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:27.982286 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8ce2cf05-9157-41cd-8504-bfbdacda7004 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7" status: 202 len: 0 microversion: 2.1 time: 0.421115 Aug 01 14:08:27.985633 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 12/29] 10.222.0.45 () {58 vars in 1254 bytes} [Mon Aug 1 14:08:27 2022] DELETE /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:08:28.009445 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6547cb7b-4e2a-4575-91be-a053aa4cc2c8 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b4fc310>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:28.671908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-6547cb7b-4e2a-4575-91be-a053aa4cc2c8 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] HTTP exception thrown: Snapshot 6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 could not be found. Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6547cb7b-4e2a-4575-91be-a053aa4cc2c8 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Request method failure captured: Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 HTTP/1.1 Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595QXm9PnuqNn_YB8PKzhWvtB9qQOWdCF1UHiD4d5Fj8-ilHfx7p6m3_XnDGUP6TO6fDZoN7o-6lV_y-HTySsCidBxn7HVTYSY804__eoG2rNM-WK396Wmi_EtD3ifkGHb0XcywpqxubgHsdMZioO2COTebZ-VHovjx9fcHERMji-88 Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: a72b3bf493df4e3a92824bd41c12c6e7 Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:08:28.677376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a72b3bf493df4e3a92824bd41c12c6e7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a72b3bf493df4e3a92824bd41c12c6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a72b3bf493df4e3a92824bd41c12c6e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a72b3bf493df4e3a92824bd41c12c6e7"}]}] Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: a72b3bf493df4e3a92824bd41c12c6e7 Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotsTestJSON-1044891695-project Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a7dd1ba60fb64c18ba5f199d8e27d167 Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1044891695-project Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Snapshot 6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 could not be found. Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7'} Aug 01 14:08:28.679405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 could not be found. (HTTP 404) (Request-ID: req-605489d9-f995-4718-be1c-14429e79724c) Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:28.680837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:28.682522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 could not be found. Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 14:08:28.684474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 could not be found. Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 could not be found. Aug 01 14:08:28.686305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:28.699267 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6547cb7b-4e2a-4575-91be-a053aa4cc2c8 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Returning 404 to user: Snapshot 6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:28.705729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6547cb7b-4e2a-4575-91be-a053aa4cc2c8 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7" status: 404 len: 111 microversion: 2.1 time: 0.715580 Aug 01 14:08:28.708803 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 18/30] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 14:08:27 2022] GET /compute/v2.1/os-snapshots/6bbe52c2-ff1f-42b7-99a5-e2d63d8bd8c7 => generated 111 bytes in 720 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:08:28.719271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3745e6f9-f952-4a8c-9d9c-7960fd89c21b tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b5b6430>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:28.935919 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3745e6f9-f952-4a8c-9d9c-7960fd89c21b tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a" status: 202 len: 0 microversion: 2.1 time: 0.222430 Aug 01 14:08:28.937706 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 13/31] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:08:28 2022] DELETE /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:08:28.946624 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-83deec28-8ba6-4aa9-b1ed-ec58a5afda45 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b536790>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:29.053960 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-83deec28-8ba6-4aa9-b1ed-ec58a5afda45 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a" status: 200 len: 345 microversion: 2.1 time: 0.110668 Aug 01 14:08:29.055116 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 19/32] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:28 2022] GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:30.075545 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8db878d4-9e39-49de-8cd4-8fef58a6901a tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b5b6d30>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:30.292742 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8db878d4-9e39-49de-8cd4-8fef58a6901a tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a" status: 200 len: 345 microversion: 2.1 time: 0.221185 Aug 01 14:08:30.294906 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 14/33] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:30 2022] GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a => generated 345 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:31.311706 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f035c6ad-fd19-42ae-929c-5ad9ebee6d35 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b4fcdc0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:31.461798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f035c6ad-fd19-42ae-929c-5ad9ebee6d35 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a" status: 200 len: 345 microversion: 2.1 time: 0.154229 Aug 01 14:08:31.463361 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 20/34] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:31 2022] GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:32.484290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a655e78a-2bf9-4b6a-9547-4554a2544754 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b4fc940>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:32.564383 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-a655e78a-2bf9-4b6a-9547-4554a2544754 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] HTTP exception thrown: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a655e78a-2bf9-4b6a-9547-4554a2544754 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Request method failure captured: Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a HTTP/1.1 Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595QXm9PnuqNn_YB8PKzhWvtB9qQOWdCF1UHiD4d5Fj8-ilHfx7p6m3_XnDGUP6TO6fDZoN7o-6lV_y-HTySsCidBxn7HVTYSY804__eoG2rNM-WK396Wmi_EtD3ifkGHb0XcywpqxubgHsdMZioO2COTebZ-VHovjx9fcHERMji-88 Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: a72b3bf493df4e3a92824bd41c12c6e7 Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:08:32.574318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a72b3bf493df4e3a92824bd41c12c6e7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a72b3bf493df4e3a92824bd41c12c6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a72b3bf493df4e3a92824bd41c12c6e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a72b3bf493df4e3a92824bd41c12c6e7"}]}] Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: a72b3bf493df4e3a92824bd41c12c6e7 Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotsTestJSON-1044891695-project Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a7dd1ba60fb64c18ba5f199d8e27d167 Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1044891695-project Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '840ebaa7-ac65-4d39-9d45-beb7c3a1973a'} Aug 01 14:08:32.576716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. (HTTP 404) (Request-ID: req-792a0e5c-11b9-48e2-9772-76296fac57f3) Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:32.577895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:32.579927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:08:32.581660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.583290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.588877 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a655e78a-2bf9-4b6a-9547-4554a2544754 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Returning 404 to user: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:32.594102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a655e78a-2bf9-4b6a-9547-4554a2544754 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a" status: 404 len: 109 microversion: 2.1 time: 0.113552 Aug 01 14:08:32.598822 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 21/35] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:32 2022] GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:08:32.619921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-15319d26-05df-47b2-bc32-1935ace08d0b tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57bf8c0d0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:32.634814 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-272769743", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "networks": [{"uuid": "92d37e39-b672-4f33-9211-a661c3b7938b"}]}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:32.696619 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-15319d26-05df-47b2-bc32-1935ace08d0b tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] HTTP exception thrown: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-15319d26-05df-47b2-bc32-1935ace08d0b tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Request method failure captured: Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a HTTP/1.1 Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595QXm9PnuqNn_YB8PKzhWvtB9qQOWdCF1UHiD4d5Fj8-ilHfx7p6m3_XnDGUP6TO6fDZoN7o-6lV_y-HTySsCidBxn7HVTYSY804__eoG2rNM-WK396Wmi_EtD3ifkGHb0XcywpqxubgHsdMZioO2COTebZ-VHovjx9fcHERMji-88 Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: a72b3bf493df4e3a92824bd41c12c6e7 Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:08:32.700634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a72b3bf493df4e3a92824bd41c12c6e7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a72b3bf493df4e3a92824bd41c12c6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a72b3bf493df4e3a92824bd41c12c6e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a72b3bf493df4e3a92824bd41c12c6e7"}]}] Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: a72b3bf493df4e3a92824bd41c12c6e7 Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotsTestJSON-1044891695-project Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a7dd1ba60fb64c18ba5f199d8e27d167 Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1044891695-project Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '840ebaa7-ac65-4d39-9d45-beb7c3a1973a'} Aug 01 14:08:32.702341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. (HTTP 404) (Request-ID: req-0252d617-c3de-40bc-a7d0-d5aecec741ef) Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:32.702975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:08:32.703885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:08:32.704809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-15319d26-05df-47b2-bc32-1935ace08d0b tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Returning 404 to user: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:32.705912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-15319d26-05df-47b2-bc32-1935ace08d0b tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a" status: 404 len: 109 microversion: 2.1 time: 0.087826 Aug 01 14:08:32.710842 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 22/36] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:08:32 2022] DELETE /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:08:32.739178 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8b2fb88e-5cd1-439b-bc05-c8231ab55759 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Calling method '.version_select at 0x7fc57b536af0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:32.811980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-8b2fb88e-5cd1-439b-bc05-c8231ab55759 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] HTTP exception thrown: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8b2fb88e-5cd1-439b-bc05-c8231ab55759 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Request method failure captured: Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a HTTP/1.1 Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595QXm9PnuqNn_YB8PKzhWvtB9qQOWdCF1UHiD4d5Fj8-ilHfx7p6m3_XnDGUP6TO6fDZoN7o-6lV_y-HTySsCidBxn7HVTYSY804__eoG2rNM-WK396Wmi_EtD3ifkGHb0XcywpqxubgHsdMZioO2COTebZ-VHovjx9fcHERMji-88 Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: a72b3bf493df4e3a92824bd41c12c6e7 Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:08:32.814602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a72b3bf493df4e3a92824bd41c12c6e7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a72b3bf493df4e3a92824bd41c12c6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a72b3bf493df4e3a92824bd41c12c6e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a72b3bf493df4e3a92824bd41c12c6e7"}]}] Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: a72b3bf493df4e3a92824bd41c12c6e7 Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1044891695 Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotsTestJSON-1044891695-project Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a7dd1ba60fb64c18ba5f199d8e27d167 Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1044891695-project Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '840ebaa7-ac65-4d39-9d45-beb7c3a1973a'} Aug 01 14:08:32.816033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. (HTTP 404) (Request-ID: req-b28ca9c3-8f3a-4b73-a462-2d975bfd7b55) Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:32.816719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:08:32.817683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:08:32.818574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8b2fb88e-5cd1-439b-bc05-c8231ab55759 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] Returning 404 to user: Volume 840ebaa7-ac65-4d39-9d45-beb7c3a1973a could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8b2fb88e-5cd1-439b-bc05-c8231ab55759 tempest-VolumesSnapshotsTestJSON-1044891695 tempest-VolumesSnapshotsTestJSON-1044891695-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a" status: 404 len: 109 microversion: 2.1 time: 0.103928 Aug 01 14:08:32.819455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 23/37] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:32 2022] GET /compute/v2.1/os-volumes/840ebaa7-ac65-4d39-9d45-beb7c3a1973a => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:08:32.887987 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] validate_networks() for [('92d37e39-b672-4f33-9211-a661c3b7938b', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:08:36.641265 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:08:36.642024 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:08:36.648159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:08:36.648767 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:08:36.649196 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:08:36.693271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:36.699041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:36.700119 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:36.702610 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:36.827306 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Getting quotas for project 075e439a5de54261b5357fe8c513e9ee. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:08:36.850949 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Getting quotas for user ed6e0b24487342c1a9246579c0854653 and project 075e439a5de54261b5357fe8c513e9ee. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:08:36.858924 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-540387228", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1aca417-45fc-4b60-8100-7ab851d89316"}], "security_groups": [{"name": "tempest-securitygroup--1385000397"}], "key_name": "tempest-keypair-1078354145", "user_data": "}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:36.889426 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:08:36.892372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:08:37.125589 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-05d06fd5-b571-40df-bf59-02d04e0a2bea tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.489289 Aug 01 14:08:37.137829 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 15/38] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:08:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 5502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:08:37.154179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-511ea8c4-c435-49e0-8c89-9b3e3a7e30a4 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:37.155248 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-511ea8c4-c435-49e0-8c89-9b3e3a7e30a4 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:37.451003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:37.524607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-511ea8c4-c435-49e0-8c89-9b3e3a7e30a4 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:37.552075 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-511ea8c4-c435-49e0-8c89-9b3e3a7e30a4 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1214 microversion: 2.1 time: 0.410332 Aug 01 14:08:37.573941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 16/39] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:37 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1214 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:37.716794 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ec254a86-d35a-432d-a469-345bbd16ebdd tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc57ac4af70>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:37.826854 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] validate_networks() for [('c1aca417-45fc-4b60-8100-7ab851d89316', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:08:37.924507 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ec254a86-d35a-432d-a469-345bbd16ebdd tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d5736f46-fc3b-408a-b787-01ca630e8513" status: 200 len: 350 microversion: 2.1 time: 0.211601 Aug 01 14:08:37.925149 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 17/40] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:37 2022] GET /compute/v2.1/os-volumes/d5736f46-fc3b-408a-b787-01ca630e8513 => generated 350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:38.574345 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6bc8bbb8-054f-4f6e-92a9-688ea327868e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:38.575153 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6bc8bbb8-054f-4f6e-92a9-688ea327868e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:38.740828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6bc8bbb8-054f-4f6e-92a9-688ea327868e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:38.755174 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6bc8bbb8-054f-4f6e-92a9-688ea327868e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1214 microversion: 2.1 time: 0.186161 Aug 01 14:08:38.755785 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 18/41] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:38 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:39.783302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8a5d5543-5af9-40b1-8952-e99cf2b630ed tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:39.784252 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8a5d5543-5af9-40b1-8952-e99cf2b630ed tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:39.830599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:08:39.831711 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:08:39.832203 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:08:39.832661 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:08:39.833258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:08:39.861295 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:39.863026 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:39.866158 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:39.868098 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:39.921539 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8a5d5543-5af9-40b1-8952-e99cf2b630ed tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:39.929191 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8a5d5543-5af9-40b1-8952-e99cf2b630ed tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1214 microversion: 2.1 time: 0.154802 Aug 01 14:08:39.929794 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 19/42] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:39 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:39.933831 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Getting quotas for project 1081ae5fd3e9443c80626517ae9c7d77. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:08:39.939939 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Getting quotas for user 87f35e960544403ea30ba36d878a86cb and project 1081ae5fd3e9443c80626517ae9c7d77. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:08:39.983701 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:08:39.986613 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:08:40.046650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-77ca7b3e-252e-4914-adba-631c2f3ef9b5 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc57a3f7af0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:40.162369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-77ca7b3e-252e-4914-adba-631c2f3ef9b5 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ab484cba-ca96-40b7-9a1d-64ffbf25cb36" status: 200 len: 350 microversion: 2.1 time: 0.126129 Aug 01 14:08:40.165761 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ad115192-e89c-4aa3-8c63-f9d554fc25a0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.320624 Aug 01 14:08:40.167327 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 24/43] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:08:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 3324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:08:40.168228 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 20/44] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:40 2022] GET /compute/v2.1/os-volumes/ab484cba-ca96-40b7-9a1d-64ffbf25cb36 => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:40.183930 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c3464197-10a6-41c7-80c3-d2e9b042a9d9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:40.186111 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c3464197-10a6-41c7-80c3-d2e9b042a9d9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:40.445296 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c3464197-10a6-41c7-80c3-d2e9b042a9d9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:40.478708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c3464197-10a6-41c7-80c3-d2e9b042a9d9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1237 microversion: 2.1 time: 0.302419 Aug 01 14:08:40.479726 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 25/45] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:40 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1237 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:40.954837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9bd631ab-915f-4e11-b2ac-1f997a452ca9 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:40.956291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9bd631ab-915f-4e11-b2ac-1f997a452ca9 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:40.977469 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9bd631ab-915f-4e11-b2ac-1f997a452ca9 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:40.990203 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9bd631ab-915f-4e11-b2ac-1f997a452ca9 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:40.993385 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9bd631ab-915f-4e11-b2ac-1f997a452ca9 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:40.994609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9bd631ab-915f-4e11-b2ac-1f997a452ca9 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:41.144370 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-779575964", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:41.277183 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] validate_networks() for [('a282ca18-1470-4a11-b809-f055c3b48a10', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:08:41.529104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9bd631ab-915f-4e11-b2ac-1f997a452ca9 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:41.570152 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9bd631ab-915f-4e11-b2ac-1f997a452ca9 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1266 microversion: 2.1 time: 0.620792 Aug 01 14:08:41.573123 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 26/46] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:40 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1266 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:41.589348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bc532f8c-144d-4175-9dbe-f45f854b215e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:41.590050 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bc532f8c-144d-4175-9dbe-f45f854b215e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:41.873822 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bc532f8c-144d-4175-9dbe-f45f854b215e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:41.883659 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bc532f8c-144d-4175-9dbe-f45f854b215e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1237 microversion: 2.1 time: 0.307080 Aug 01 14:08:41.889681 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 27/47] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:41 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1237 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:42.186493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b1d6fb34-3535-4d92-9e6a-f035fe4ff87e tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc579bb1af0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:42.289894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b1d6fb34-3535-4d92-9e6a-f035fe4ff87e tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/3042f8ec-f6b9-4b50-ba38-4dda83fa79f4" status: 200 len: 350 microversion: 2.1 time: 0.115376 Aug 01 14:08:42.292800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 28/48] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:42 2022] GET /compute/v2.1/os-volumes/3042f8ec-f6b9-4b50-ba38-4dda83fa79f4 => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:42.311482 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-879b9107-f317-4401-bc3c-5e0030f8b1eb tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc579b46310>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:42.469570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:08:42.470114 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:08:42.470637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:08:42.471283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:08:42.471895 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:08:42.491601 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:42.493396 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:42.496453 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:42.498866 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:42.566244 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Getting quotas for project e85f3e6c18ae4466a1dc3e6464aa18e6. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:08:42.574362 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-879b9107-f317-4401-bc3c-5e0030f8b1eb tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.274086 Aug 01 14:08:42.575630 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 29/49] 10.222.0.45 () {58 vars in 1134 bytes} [Mon Aug 1 14:08:42 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:42.592415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1764736a-c113-44e1-8cf0-3c295cabb689 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc579bb1940>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:42.598821 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Getting quotas for user a3e93dfa85244133b1641a431994b47f and project e85f3e6c18ae4466a1dc3e6464aa18e6. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:08:42.644923 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:08:42.653842 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:08:42.807727 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-dab9a240-99ac-47de-bb2e-efc48827c2d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.447522 Aug 01 14:08:42.809460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 21/50] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:08:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:08:42.814786 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1764736a-c113-44e1-8cf0-3c295cabb689 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.229297 Aug 01 14:08:42.816642 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 30/51] 10.222.0.45 () {58 vars in 1149 bytes} [Mon Aug 1 14:08:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:42.823188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9d0be03f-f01e-4aad-84b5-11b64cc3e684 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:42.824152 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9d0be03f-f01e-4aad-84b5-11b64cc3e684 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:42.864103 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-24466faa-13e5-45db-9c8c-58fe55a70d60 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:42.872300 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-24466faa-13e5-45db-9c8c-58fe55a70d60 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:42.897269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-24466faa-13e5-45db-9c8c-58fe55a70d60 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:42.902847 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-24466faa-13e5-45db-9c8c-58fe55a70d60 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:42.903983 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-24466faa-13e5-45db-9c8c-58fe55a70d60 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:42.906541 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-24466faa-13e5-45db-9c8c-58fe55a70d60 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:43.034115 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9d0be03f-f01e-4aad-84b5-11b64cc3e684 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:43.043842 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9d0be03f-f01e-4aad-84b5-11b64cc3e684 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1221 microversion: 2.1 time: 0.225907 Aug 01 14:08:43.047268 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 31/52] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:42 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1221 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:43.061371 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-df09fce0-6860-4d2c-88cd-f3254c8be738 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc579b4bdc0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:43.437390 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-24466faa-13e5-45db-9c8c-58fe55a70d60 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:43.462202 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-24466faa-13e5-45db-9c8c-58fe55a70d60 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1272 microversion: 2.1 time: 0.649473 Aug 01 14:08:43.462935 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 22/53] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:42 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1272 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:43.476625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f28d60c4-fa88-4963-aa1a-f03cb58be21e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:43.476625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f28d60c4-fa88-4963-aa1a-f03cb58be21e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:43.507279 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f28d60c4-fa88-4963-aa1a-f03cb58be21e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:43.507863 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f28d60c4-fa88-4963-aa1a-f03cb58be21e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:43.508531 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f28d60c4-fa88-4963-aa1a-f03cb58be21e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:43.508962 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f28d60c4-fa88-4963-aa1a-f03cb58be21e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:43.622697 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-df09fce0-6860-4d2c-88cd-f3254c8be738 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.573368 Aug 01 14:08:43.623312 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 32/54] 10.222.0.45 () {58 vars in 1134 bytes} [Mon Aug 1 14:08:43 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:43.661598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-505552248", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:43.805773 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f28d60c4-fa88-4963-aa1a-f03cb58be21e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:43.817737 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f28d60c4-fa88-4963-aa1a-f03cb58be21e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1297 microversion: 2.1 time: 0.353638 Aug 01 14:08:43.823397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 23/55] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:43 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1297 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:43.836881 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] validate_networks() for [('a282ca18-1470-4a11-b809-f055c3b48a10', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:08:43.856769 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ccdcb74d-46be-4ee3-81a0-9f8d97d67286 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc57a3a99d0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:44.108597 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ccdcb74d-46be-4ee3-81a0-9f8d97d67286 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.259439 Aug 01 14:08:44.109442 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 24/56] 10.222.0.45 () {58 vars in 1167 bytes} [Mon Aug 1 14:08:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:44.123432 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-73acb115-37bb-4128-8b2d-3c72b3eb7370 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc57a3f4af0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:44.367287 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-73acb115-37bb-4128-8b2d-3c72b3eb7370 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.248022 Aug 01 14:08:44.368202 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 25/57] 10.222.0.45 () {58 vars in 1170 bytes} [Mon Aug 1 14:08:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:44.381713 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-74b79e4e-a785-45f1-b19d-71c9fb61aaf6 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc57a3434c0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:44.713057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-74b79e4e-a785-45f1-b19d-71c9fb61aaf6 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.335625 Aug 01 14:08:44.714059 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 26/58] 10.222.0.45 () {58 vars in 1155 bytes} [Mon Aug 1 14:08:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:44.719529 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a49a8aee-2dea-4197-8433-a47b9e4d5012 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:44.720500 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a49a8aee-2dea-4197-8433-a47b9e4d5012 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:44.743494 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a49a8aee-2dea-4197-8433-a47b9e4d5012 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:44.763311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a49a8aee-2dea-4197-8433-a47b9e4d5012 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:44.766395 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a49a8aee-2dea-4197-8433-a47b9e4d5012 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:44.766917 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a49a8aee-2dea-4197-8433-a47b9e4d5012 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:47.096528 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a49a8aee-2dea-4197-8433-a47b9e4d5012 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:47.107800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a49a8aee-2dea-4197-8433-a47b9e4d5012 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 2.392177 Aug 01 14:08:47.114001 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 27/59] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:44 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:47.133532 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9682f999-e07b-47dd-8b3a-aa265fb8ce77 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc57a3f7700>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:47.440645 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9682f999-e07b-47dd-8b3a-aa265fb8ce77 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.325235 Aug 01 14:08:47.442373 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 28/60] 10.222.0.45 () {58 vars in 1188 bytes} [Mon Aug 1 14:08:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:47.448666 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-869f6a65-2558-4368-8575-746dc1da0bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:47.450556 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-869f6a65-2558-4368-8575-746dc1da0bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:47.469458 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-869f6a65-2558-4368-8575-746dc1da0bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:47.475635 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-869f6a65-2558-4368-8575-746dc1da0bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:47.493820 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-869f6a65-2558-4368-8575-746dc1da0bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:47.495763 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-869f6a65-2558-4368-8575-746dc1da0bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:48.147048 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-869f6a65-2558-4368-8575-746dc1da0bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:48.158040 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-869f6a65-2558-4368-8575-746dc1da0bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1295 microversion: 2.1 time: 0.714027 Aug 01 14:08:48.167694 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 29/61] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:47 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1295 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:48.187364 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-984e0e94-9493-4cab-9180-e56d506ac1f3 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] Calling method '.version_select at 0x7fc57a37f280>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:48.223813 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:08:48.224528 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:08:48.225052 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:08:48.227943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:08:48.228645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:08:48.271258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:48.272009 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:48.273249 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:48.274035 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:48.351504 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Getting quotas for project e85f3e6c18ae4466a1dc3e6464aa18e6. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:08:48.369937 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Getting quotas for user a3e93dfa85244133b1641a431994b47f and project e85f3e6c18ae4466a1dc3e6464aa18e6. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:08:48.426162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:08:48.433063 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:08:48.534297 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-984e0e94-9493-4cab-9180-e56d506ac1f3 tempest-VolumesTestJSON-1679911950 tempest-VolumesTestJSON-1679911950-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.364767 Aug 01 14:08:48.535119 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 30/62] 10.222.0.45 () {58 vars in 1155 bytes} [Mon Aug 1 14:08:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:48.539994 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-eb374d64-b041-4817-9095-d9df1480279d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:48.540643 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-eb374d64-b041-4817-9095-d9df1480279d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:48.567550 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eb374d64-b041-4817-9095-d9df1480279d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:48.568007 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eb374d64-b041-4817-9095-d9df1480279d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:48.568867 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eb374d64-b041-4817-9095-d9df1480279d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:48.578572 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eb374d64-b041-4817-9095-d9df1480279d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:48.628701 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-161c706c-c5e8-4903-9654-258947ca45ff tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.986857 Aug 01 14:08:48.636432 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 33/63] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:08:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 5012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:08:48.668610 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5c096516-5689-4550-9efe-538f30fa1096 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:48.672449 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5c096516-5689-4550-9efe-538f30fa1096 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:49.043841 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5c096516-5689-4550-9efe-538f30fa1096 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:49.126737 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5c096516-5689-4550-9efe-538f30fa1096 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1221 microversion: 2.1 time: 0.478303 Aug 01 14:08:49.132314 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 34/64] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:48 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1221 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:49.192765 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c9280055-10b4-4e2e-8668-6db6ae128c13 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:49.194254 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c9280055-10b4-4e2e-8668-6db6ae128c13 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:49.225001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c9280055-10b4-4e2e-8668-6db6ae128c13 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:49.225001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c9280055-10b4-4e2e-8668-6db6ae128c13 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:49.225001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c9280055-10b4-4e2e-8668-6db6ae128c13 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:49.225001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c9280055-10b4-4e2e-8668-6db6ae128c13 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:49.572918 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-eb374d64-b041-4817-9095-d9df1480279d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:49.613618 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-eb374d64-b041-4817-9095-d9df1480279d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 1.077140 Aug 01 14:08:49.620397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 31/65] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:48 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:49.879470 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c9280055-10b4-4e2e-8668-6db6ae128c13 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:49.889002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c9280055-10b4-4e2e-8668-6db6ae128c13 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.702230 Aug 01 14:08:49.925726 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 35/66] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:49 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:50.157457 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-90a52c3f-611c-4c40-a078-149138921c98 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:50.158727 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-90a52c3f-611c-4c40-a078-149138921c98 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:50.177539 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90a52c3f-611c-4c40-a078-149138921c98 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:50.178314 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90a52c3f-611c-4c40-a078-149138921c98 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:50.179846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90a52c3f-611c-4c40-a078-149138921c98 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:50.180594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90a52c3f-611c-4c40-a078-149138921c98 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:50.493320 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-90a52c3f-611c-4c40-a078-149138921c98 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:50.503021 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-90a52c3f-611c-4c40-a078-149138921c98 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1217 microversion: 2.1 time: 0.349890 Aug 01 14:08:50.510158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 32/67] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:50 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1217 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:50.640919 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4d1d6ef4-bf16-4397-988a-ece272a42b28 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:50.641554 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4d1d6ef4-bf16-4397-988a-ece272a42b28 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:50.655895 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4d1d6ef4-bf16-4397-988a-ece272a42b28 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:50.656978 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4d1d6ef4-bf16-4397-988a-ece272a42b28 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:50.658753 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4d1d6ef4-bf16-4397-988a-ece272a42b28 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:50.659474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4d1d6ef4-bf16-4397-988a-ece272a42b28 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:50.696656 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-1237da92-8bc2-4182-b896-bf78bab16dc2 req-52e094a9-bcdb-47b5-be6b-4556d85422b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017caf5e-f276-4e12-9a46-cc2d666cd313", "tag": "6af8bd7d-b81c-4d73-820b-78155d3d21f6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:50.736973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-1237da92-8bc2-4182-b896-bf78bab16dc2 req-52e094a9-bcdb-47b5-be6b-4556d85422b2 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:50.737448 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-1237da92-8bc2-4182-b896-bf78bab16dc2 req-52e094a9-bcdb-47b5-be6b-4556d85422b2 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:50.816657 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-1237da92-8bc2-4182-b896-bf78bab16dc2 req-52e094a9-bcdb-47b5-be6b-4556d85422b2 service nova] Creating event network-changed:6af8bd7d-b81c-4d73-820b-78155d3d21f6 for instance 017caf5e-f276-4e12-9a46-cc2d666cd313 on hv-cinder-84517 Aug 01 14:08:50.818270 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-1237da92-8bc2-4182-b896-bf78bab16dc2 req-52e094a9-bcdb-47b5-be6b-4556d85422b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118111) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 14:08:50.821451 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c287ba77-c4a2-4da2-9aa0-d90d61d7b158 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:50.822944 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c287ba77-c4a2-4da2-9aa0-d90d61d7b158 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:50.825620 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c287ba77-c4a2-4da2-9aa0-d90d61d7b158 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:50.827529 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c287ba77-c4a2-4da2-9aa0-d90d61d7b158 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:50.866216 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.compute.rpcapi [None req-c287ba77-c4a2-4da2-9aa0-d90d61d7b158 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 14:08:50.875316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c287ba77-c4a2-4da2-9aa0-d90d61d7b158 None None] Releasing lock "compute-rpcapi-router" {{(pid=118111) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 14:08:50.932366 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c287ba77-c4a2-4da2-9aa0-d90d61d7b158 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.454100 Aug 01 14:08:50.934025 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 36/68] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:50.944169 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9086ef36-1078-4b46-ae3a-994665e2153f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:50.947733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9086ef36-1078-4b46-ae3a-994665e2153f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:50.966558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9086ef36-1078-4b46-ae3a-994665e2153f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:50.969873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9086ef36-1078-4b46-ae3a-994665e2153f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:50.975206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9086ef36-1078-4b46-ae3a-994665e2153f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:50.976032 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9086ef36-1078-4b46-ae3a-994665e2153f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:52.165295 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4d1d6ef4-bf16-4397-988a-ece272a42b28 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:52.174770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9086ef36-1078-4b46-ae3a-994665e2153f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:52.186752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9086ef36-1078-4b46-ae3a-994665e2153f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 1.251281 Aug 01 14:08:52.187386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4d1d6ef4-bf16-4397-988a-ece272a42b28 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 1.552282 Aug 01 14:08:52.187972 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 37/69] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:50 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:52.194826 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 33/70] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:50 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:52.213835 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-732fefa0-9970-4d77-a081-2a014d1b1b92 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:52.216120 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-732fefa0-9970-4d77-a081-2a014d1b1b92 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:52.224264 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-732fefa0-9970-4d77-a081-2a014d1b1b92 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:52.225107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-732fefa0-9970-4d77-a081-2a014d1b1b92 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:52.226114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-732fefa0-9970-4d77-a081-2a014d1b1b92 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:52.226817 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-732fefa0-9970-4d77-a081-2a014d1b1b92 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:52.524898 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-732fefa0-9970-4d77-a081-2a014d1b1b92 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:52.542045 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-732fefa0-9970-4d77-a081-2a014d1b1b92 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1281 microversion: 2.1 time: 0.352685 Aug 01 14:08:52.543385 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 38/71] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:52 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1281 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:53.060511 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-079acf1a-889c-4b18-9804-961f3de4f1db req-22a31748-b361-4751-b12e-b706548b4b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36838f66-2529-4a98-88cd-4a0450c2aba5", "tag": "6435f407-545f-4889-be82-4de3b791eeb8"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:53.143615 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=4 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:53.147154 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=18 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:53.155099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-079acf1a-889c-4b18-9804-961f3de4f1db req-22a31748-b361-4751-b12e-b706548b4b0f service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:53.156472 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-079acf1a-889c-4b18-9804-961f3de4f1db req-22a31748-b361-4751-b12e-b706548b4b0f service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:53.212103 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0fea81f0-642d-49b7-ae19-a4ad5853c37a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:53.213407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0fea81f0-642d-49b7-ae19-a4ad5853c37a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:53.229926 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0fea81f0-642d-49b7-ae19-a4ad5853c37a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:53.232980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0fea81f0-642d-49b7-ae19-a4ad5853c37a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:53.234611 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0fea81f0-642d-49b7-ae19-a4ad5853c37a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:53.238225 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0fea81f0-642d-49b7-ae19-a4ad5853c37a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:53.246132 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-079acf1a-889c-4b18-9804-961f3de4f1db req-22a31748-b361-4751-b12e-b706548b4b0f service nova] Creating event network-changed:6435f407-545f-4889-be82-4de3b791eeb8 for instance 36838f66-2529-4a98-88cd-4a0450c2aba5 on hv-cinder-84517 Aug 01 14:08:53.247932 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-079acf1a-889c-4b18-9804-961f3de4f1db req-22a31748-b361-4751-b12e-b706548b4b0f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118110) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 14:08:53.254776 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-749d4e43-98ad-447c-8187-fcdd8cb6a1a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:53.256071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-749d4e43-98ad-447c-8187-fcdd8cb6a1a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:53.257659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-749d4e43-98ad-447c-8187-fcdd8cb6a1a1 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:53.258570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-749d4e43-98ad-447c-8187-fcdd8cb6a1a1 None None] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:53.288230 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.compute.rpcapi [None req-749d4e43-98ad-447c-8187-fcdd8cb6a1a1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 14:08:53.291410 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-749d4e43-98ad-447c-8187-fcdd8cb6a1a1 None None] Releasing lock "compute-rpcapi-router" {{(pid=118110) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 14:08:53.339794 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-749d4e43-98ad-447c-8187-fcdd8cb6a1a1 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296333 Aug 01 14:08:53.340626 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 34/72] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:53.349753 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0356d4ba-55b4-40ac-9c6c-618c02d317a8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:53.354499 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0356d4ba-55b4-40ac-9c6c-618c02d317a8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:53.372684 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0356d4ba-55b4-40ac-9c6c-618c02d317a8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:53.373309 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0356d4ba-55b4-40ac-9c6c-618c02d317a8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:53.374874 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0356d4ba-55b4-40ac-9c6c-618c02d317a8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:53.376878 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0356d4ba-55b4-40ac-9c6c-618c02d317a8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:53.989482 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0356d4ba-55b4-40ac-9c6c-618c02d317a8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:53.999380 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0356d4ba-55b4-40ac-9c6c-618c02d317a8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.657307 Aug 01 14:08:54.005438 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0fea81f0-642d-49b7-ae19-a4ad5853c37a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:54.009334 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 35/73] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:53 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:54.020435 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0fea81f0-642d-49b7-ae19-a4ad5853c37a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.812087 Aug 01 14:08:54.030807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 39/74] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:53 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:54.064472 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-64c107d4-d100-4c82-9553-d6d370c90b96 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:54.068970 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-64c107d4-d100-4c82-9553-d6d370c90b96 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:54.094112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64c107d4-d100-4c82-9553-d6d370c90b96 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:54.106393 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64c107d4-d100-4c82-9553-d6d370c90b96 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:54.113804 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64c107d4-d100-4c82-9553-d6d370c90b96 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:54.114605 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64c107d4-d100-4c82-9553-d6d370c90b96 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:54.287940 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-2ef0436c-7f17-46f9-83fe-4d3f3abf0502 req-3353459f-9f94-4e11-8f7b-5fc6e7a6068b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8", "tag": "82f43520-38c1-414e-b0a4-66b27e6ff60b"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:54.304904 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-2ef0436c-7f17-46f9-83fe-4d3f3abf0502 req-3353459f-9f94-4e11-8f7b-5fc6e7a6068b service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:54.305846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-2ef0436c-7f17-46f9-83fe-4d3f3abf0502 req-3353459f-9f94-4e11-8f7b-5fc6e7a6068b service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:54.324126 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-2ef0436c-7f17-46f9-83fe-4d3f3abf0502 req-3353459f-9f94-4e11-8f7b-5fc6e7a6068b service nova] Creating event network-changed:82f43520-38c1-414e-b0a4-66b27e6ff60b for instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 on hv-cinder-84517 Aug 01 14:08:54.330552 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-2ef0436c-7f17-46f9-83fe-4d3f3abf0502 req-3353459f-9f94-4e11-8f7b-5fc6e7a6068b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317375 Aug 01 14:08:54.332173 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 36/75] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:54.474940 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-64c107d4-d100-4c82-9553-d6d370c90b96 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:54.486716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-64c107d4-d100-4c82-9553-d6d370c90b96 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1279 microversion: 2.1 time: 0.452402 Aug 01 14:08:54.490752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 40/76] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:54 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1279 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:55.025938 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2706e3f4-e7e6-4d66-838a-2172f2dc2af0 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:55.026895 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2706e3f4-e7e6-4d66-838a-2172f2dc2af0 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:55.035053 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2706e3f4-e7e6-4d66-838a-2172f2dc2af0 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:55.036149 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2706e3f4-e7e6-4d66-838a-2172f2dc2af0 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:55.037304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2706e3f4-e7e6-4d66-838a-2172f2dc2af0 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:55.038077 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2706e3f4-e7e6-4d66-838a-2172f2dc2af0 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:55.063195 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f5f3b4d7-cd47-466d-bdda-abfcbb87ac7a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:55.064221 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f5f3b4d7-cd47-466d-bdda-abfcbb87ac7a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:55.078805 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5f3b4d7-cd47-466d-bdda-abfcbb87ac7a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:55.079692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5f3b4d7-cd47-466d-bdda-abfcbb87ac7a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:55.082715 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5f3b4d7-cd47-466d-bdda-abfcbb87ac7a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:55.083572 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5f3b4d7-cd47-466d-bdda-abfcbb87ac7a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:55.429906 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2706e3f4-e7e6-4d66-838a-2172f2dc2af0 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:55.443071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2706e3f4-e7e6-4d66-838a-2172f2dc2af0 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.421700 Aug 01 14:08:55.447556 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f5f3b4d7-cd47-466d-bdda-abfcbb87ac7a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:55.448963 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 37/77] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:55 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:55.455372 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f5f3b4d7-cd47-466d-bdda-abfcbb87ac7a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.397280 Aug 01 14:08:55.456040 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 41/78] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:55 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:55.511846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-eb75fb9b-da45-4c61-ab6b-573ecb3a5ff8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:55.512846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-eb75fb9b-da45-4c61-ab6b-573ecb3a5ff8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:55.525712 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eb75fb9b-da45-4c61-ab6b-573ecb3a5ff8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:55.527070 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eb75fb9b-da45-4c61-ab6b-573ecb3a5ff8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:55.529037 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eb75fb9b-da45-4c61-ab6b-573ecb3a5ff8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:55.531473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eb75fb9b-da45-4c61-ab6b-573ecb3a5ff8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:55.734805 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-eb75fb9b-da45-4c61-ab6b-573ecb3a5ff8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:55.747140 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-eb75fb9b-da45-4c61-ab6b-573ecb3a5ff8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.239663 Aug 01 14:08:55.748069 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 38/79] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:55 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:56.471925 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-160600b7-eada-4667-9df4-a9878a867807 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:56.472812 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-160600b7-eada-4667-9df4-a9878a867807 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:56.478724 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-be0bb497-8e36-405a-b4cf-fc01cd8b2dc2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:56.480203 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-160600b7-eada-4667-9df4-a9878a867807 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:56.480749 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-160600b7-eada-4667-9df4-a9878a867807 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:56.481172 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-be0bb497-8e36-405a-b4cf-fc01cd8b2dc2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:56.481798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-160600b7-eada-4667-9df4-a9878a867807 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:56.482765 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-160600b7-eada-4667-9df4-a9878a867807 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:56.488635 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-be0bb497-8e36-405a-b4cf-fc01cd8b2dc2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:56.489428 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-be0bb497-8e36-405a-b4cf-fc01cd8b2dc2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:56.490840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-be0bb497-8e36-405a-b4cf-fc01cd8b2dc2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:56.492076 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-be0bb497-8e36-405a-b4cf-fc01cd8b2dc2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:56.719384 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-160600b7-eada-4667-9df4-a9878a867807 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:56.731008 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-160600b7-eada-4667-9df4-a9878a867807 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.261820 Aug 01 14:08:56.731855 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 42/80] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:56 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:56.771259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-556b6248-10e3-4be7-87b9-0f0933e55039 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:56.773589 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-556b6248-10e3-4be7-87b9-0f0933e55039 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:56.784793 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:56.792073 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-be0bb497-8e36-405a-b4cf-fc01cd8b2dc2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:56.794978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-556b6248-10e3-4be7-87b9-0f0933e55039 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:56.795609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-556b6248-10e3-4be7-87b9-0f0933e55039 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:56.796692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-556b6248-10e3-4be7-87b9-0f0933e55039 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:56.797275 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-556b6248-10e3-4be7-87b9-0f0933e55039 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:56.816851 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-be0bb497-8e36-405a-b4cf-fc01cd8b2dc2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.342532 Aug 01 14:08:56.837159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 39/81] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:56 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:57.006414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-556b6248-10e3-4be7-87b9-0f0933e55039 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:57.015639 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-556b6248-10e3-4be7-87b9-0f0933e55039 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.250002 Aug 01 14:08:57.016970 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 43/82] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:56 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:57.757255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ba6ca6f9-fe3b-4a6f-acd0-31d55ab15edb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:57.757837 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ba6ca6f9-fe3b-4a6f-acd0-31d55ab15edb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:57.761724 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:57.772458 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ba6ca6f9-fe3b-4a6f-acd0-31d55ab15edb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:57.773307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ba6ca6f9-fe3b-4a6f-acd0-31d55ab15edb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:57.774746 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ba6ca6f9-fe3b-4a6f-acd0-31d55ab15edb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:57.775412 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ba6ca6f9-fe3b-4a6f-acd0-31d55ab15edb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:57.782415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=77 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:57.850966 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3a97e1f1-5547-485f-9f7e-703668c2f8ad tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:57.855759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3a97e1f1-5547-485f-9f7e-703668c2f8ad tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:57.873925 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a97e1f1-5547-485f-9f7e-703668c2f8ad tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:57.876388 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a97e1f1-5547-485f-9f7e-703668c2f8ad tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:57.880160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a97e1f1-5547-485f-9f7e-703668c2f8ad tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:57.880983 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a97e1f1-5547-485f-9f7e-703668c2f8ad tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:58.078727 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ba6ca6f9-fe3b-4a6f-acd0-31d55ab15edb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:58.091816 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ba6ca6f9-fe3b-4a6f-acd0-31d55ab15edb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.340412 Aug 01 14:08:58.097332 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 40/83] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:57 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:58.103159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a2895abe-96ac-4bdf-9766-fcd5a28db53a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:58.103774 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a2895abe-96ac-4bdf-9766-fcd5a28db53a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:58.115963 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3a97e1f1-5547-485f-9f7e-703668c2f8ad tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:58.124574 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2895abe-96ac-4bdf-9766-fcd5a28db53a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:58.126193 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2895abe-96ac-4bdf-9766-fcd5a28db53a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:58.127765 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3a97e1f1-5547-485f-9f7e-703668c2f8ad tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.285891 Aug 01 14:08:58.128557 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 44/84] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:57 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:58.129834 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2895abe-96ac-4bdf-9766-fcd5a28db53a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:58.131756 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2895abe-96ac-4bdf-9766-fcd5a28db53a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:58.639129 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a2895abe-96ac-4bdf-9766-fcd5a28db53a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:58.649411 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a2895abe-96ac-4bdf-9766-fcd5a28db53a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.550531 Aug 01 14:08:58.650112 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 41/85] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:58 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:59.115747 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6f8f5ef5-ccd4-4306-bccf-f80e69560675 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:59.117045 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6f8f5ef5-ccd4-4306-bccf-f80e69560675 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:59.123391 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=20 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:59.125208 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f8f5ef5-ccd4-4306-bccf-f80e69560675 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:59.125852 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f8f5ef5-ccd4-4306-bccf-f80e69560675 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:59.127129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f8f5ef5-ccd4-4306-bccf-f80e69560675 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:59.127880 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f8f5ef5-ccd4-4306-bccf-f80e69560675 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:59.150692 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a9fda9c6-901e-4263-8687-db3106215d8a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:59.151335 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a9fda9c6-901e-4263-8687-db3106215d8a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:59.164069 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a9fda9c6-901e-4263-8687-db3106215d8a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:59.164571 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a9fda9c6-901e-4263-8687-db3106215d8a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:59.165355 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a9fda9c6-901e-4263-8687-db3106215d8a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:59.165809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a9fda9c6-901e-4263-8687-db3106215d8a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:59.331170 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6f8f5ef5-ccd4-4306-bccf-f80e69560675 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:59.340878 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6f8f5ef5-ccd4-4306-bccf-f80e69560675 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.229071 Aug 01 14:08:59.356703 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 45/86] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:59 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:59.404180 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a9fda9c6-901e-4263-8687-db3106215d8a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:59.412547 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a9fda9c6-901e-4263-8687-db3106215d8a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.267134 Aug 01 14:08:59.424297 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 42/87] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:59 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:59.670900 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-80eccdb2-cf78-409f-b300-61bbeed3cb39 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:59.673386 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-80eccdb2-cf78-409f-b300-61bbeed3cb39 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:08:59.681856 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-80eccdb2-cf78-409f-b300-61bbeed3cb39 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:59.682494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-80eccdb2-cf78-409f-b300-61bbeed3cb39 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:59.683580 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-80eccdb2-cf78-409f-b300-61bbeed3cb39 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:59.684157 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-80eccdb2-cf78-409f-b300-61bbeed3cb39 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:59.856758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-80eccdb2-cf78-409f-b300-61bbeed3cb39 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:08:59.867492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-80eccdb2-cf78-409f-b300-61bbeed3cb39 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.200230 Aug 01 14:08:59.872429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 46/88] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:08:59 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:00.370940 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c1d56237-d81e-4d3b-83a3-22855b87f19a tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:00.371806 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c1d56237-d81e-4d3b-83a3-22855b87f19a tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:00.379161 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c1d56237-d81e-4d3b-83a3-22855b87f19a tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:00.379706 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c1d56237-d81e-4d3b-83a3-22855b87f19a tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:00.380595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c1d56237-d81e-4d3b-83a3-22855b87f19a tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:00.381104 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c1d56237-d81e-4d3b-83a3-22855b87f19a tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:00.435810 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cbac8cbf-150f-4fcc-a13f-af0c4c88c61c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:00.436489 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cbac8cbf-150f-4fcc-a13f-af0c4c88c61c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:00.446774 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbac8cbf-150f-4fcc-a13f-af0c4c88c61c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:00.452125 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbac8cbf-150f-4fcc-a13f-af0c4c88c61c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:00.453347 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbac8cbf-150f-4fcc-a13f-af0c4c88c61c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:00.454071 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbac8cbf-150f-4fcc-a13f-af0c4c88c61c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:00.856523 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:00.868245 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c1d56237-d81e-4d3b-83a3-22855b87f19a tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:00.877954 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c1d56237-d81e-4d3b-83a3-22855b87f19a tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.511395 Aug 01 14:09:00.888657 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 43/89] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:00 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:00.908179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f1c063c0-904b-4079-894b-7d5589a1679d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:00.908829 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f1c063c0-904b-4079-894b-7d5589a1679d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:00.925116 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f1c063c0-904b-4079-894b-7d5589a1679d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:00.925581 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f1c063c0-904b-4079-894b-7d5589a1679d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:00.926408 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f1c063c0-904b-4079-894b-7d5589a1679d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:00.926883 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f1c063c0-904b-4079-894b-7d5589a1679d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:00.941758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cbac8cbf-150f-4fcc-a13f-af0c4c88c61c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:00.956861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cbac8cbf-150f-4fcc-a13f-af0c4c88c61c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.526430 Aug 01 14:09:00.958019 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 47/90] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:00 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:01.266207 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f1c063c0-904b-4079-894b-7d5589a1679d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:01.278917 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f1c063c0-904b-4079-894b-7d5589a1679d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.374918 Aug 01 14:09:01.279513 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 44/91] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:00 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:01.619710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-c9d8ec2d-16f3-4366-84a0-6f7fd8113ef9 req-c98dc5ca-7977-4c55-ab10-764011c4aaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa86ccd-b145-4025-88ba-1962fcddee29", "tag": "7086f705-ac19-4c95-a617-0872f904d724"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:01.632772 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c9d8ec2d-16f3-4366-84a0-6f7fd8113ef9 req-c98dc5ca-7977-4c55-ab10-764011c4aaf9 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:01.633454 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c9d8ec2d-16f3-4366-84a0-6f7fd8113ef9 req-c98dc5ca-7977-4c55-ab10-764011c4aaf9 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:01.647318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-c9d8ec2d-16f3-4366-84a0-6f7fd8113ef9 req-c98dc5ca-7977-4c55-ab10-764011c4aaf9 service nova] Creating event network-changed:7086f705-ac19-4c95-a617-0872f904d724 for instance 2fa86ccd-b145-4025-88ba-1962fcddee29 on hv-cinder-84517 Aug 01 14:09:01.653590 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-c9d8ec2d-16f3-4366-84a0-6f7fd8113ef9 req-c98dc5ca-7977-4c55-ab10-764011c4aaf9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038673 Aug 01 14:09:01.654196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 48/92] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:01.910612 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a6507d1f-b278-4726-98b7-b3bec9a526e5 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:01.911122 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a6507d1f-b278-4726-98b7-b3bec9a526e5 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:01.920153 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6507d1f-b278-4726-98b7-b3bec9a526e5 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:01.920646 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6507d1f-b278-4726-98b7-b3bec9a526e5 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:01.921443 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6507d1f-b278-4726-98b7-b3bec9a526e5 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:01.921884 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6507d1f-b278-4726-98b7-b3bec9a526e5 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:01.980426 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-09c91919-72bd-47c8-a9b9-fe50b341f9e7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:01.981207 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-09c91919-72bd-47c8-a9b9-fe50b341f9e7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:01.990220 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09c91919-72bd-47c8-a9b9-fe50b341f9e7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:01.990220 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09c91919-72bd-47c8-a9b9-fe50b341f9e7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:01.990220 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09c91919-72bd-47c8-a9b9-fe50b341f9e7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:01.990220 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09c91919-72bd-47c8-a9b9-fe50b341f9e7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:02.263373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-09c91919-72bd-47c8-a9b9-fe50b341f9e7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:02.269104 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a6507d1f-b278-4726-98b7-b3bec9a526e5 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:02.273920 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-09c91919-72bd-47c8-a9b9-fe50b341f9e7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.297569 Aug 01 14:09:02.275798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 49/93] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:01 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:02.289234 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a6507d1f-b278-4726-98b7-b3bec9a526e5 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.382943 Aug 01 14:09:02.290904 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 45/94] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:01 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:02.303246 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-46be81ce-4991-45ae-9a9b-d5527d84042b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:02.304168 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-46be81ce-4991-45ae-9a9b-d5527d84042b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:02.313775 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46be81ce-4991-45ae-9a9b-d5527d84042b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:02.329216 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46be81ce-4991-45ae-9a9b-d5527d84042b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:02.331921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46be81ce-4991-45ae-9a9b-d5527d84042b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:02.332406 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46be81ce-4991-45ae-9a9b-d5527d84042b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:02.536839 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-46be81ce-4991-45ae-9a9b-d5527d84042b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:02.542120 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:02.552020 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-46be81ce-4991-45ae-9a9b-d5527d84042b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.255055 Aug 01 14:09:02.553645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 50/95] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:02 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:03.300964 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-7b40c248-febe-47be-bdea-2899838b36a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:03.300964 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-7b40c248-febe-47be-bdea-2899838b36a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:03.300964 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.306225 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7b40c248-febe-47be-bdea-2899838b36a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:03.306666 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7b40c248-febe-47be-bdea-2899838b36a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:03.307474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7b40c248-febe-47be-bdea-2899838b36a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:03.307907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7b40c248-febe-47be-bdea-2899838b36a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:03.326652 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bfa6a003-bd12-4989-afa8-625ce208a01d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:03.327467 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bfa6a003-bd12-4989-afa8-625ce208a01d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:03.334535 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfa6a003-bd12-4989-afa8-625ce208a01d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:03.335064 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfa6a003-bd12-4989-afa8-625ce208a01d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:03.335914 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfa6a003-bd12-4989-afa8-625ce208a01d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:03.336483 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfa6a003-bd12-4989-afa8-625ce208a01d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:03.504098 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-7b40c248-febe-47be-bdea-2899838b36a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:03.511739 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-7b40c248-febe-47be-bdea-2899838b36a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.217992 Aug 01 14:09:03.512366 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 46/96] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:03 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:03.537374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bfa6a003-bd12-4989-afa8-625ce208a01d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:03.543772 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bfa6a003-bd12-4989-afa8-625ce208a01d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.221523 Aug 01 14:09:03.544391 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 51/97] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:03 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:03.573260 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f0f5290b-38f2-4c41-af9e-4b60bf0968bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:03.573855 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f0f5290b-38f2-4c41-af9e-4b60bf0968bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:03.580129 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f0f5290b-38f2-4c41-af9e-4b60bf0968bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:03.580803 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f0f5290b-38f2-4c41-af9e-4b60bf0968bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:03.581637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f0f5290b-38f2-4c41-af9e-4b60bf0968bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:03.582064 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f0f5290b-38f2-4c41-af9e-4b60bf0968bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:03.717362 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f0f5290b-38f2-4c41-af9e-4b60bf0968bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:03.726231 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f0f5290b-38f2-4c41-af9e-4b60bf0968bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.156862 Aug 01 14:09:03.726864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 47/98] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:03 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:04.533222 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2fb28998-4721-454f-a54f-9a0d8b8e8cd1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:04.534556 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2fb28998-4721-454f-a54f-9a0d8b8e8cd1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:04.542675 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fb28998-4721-454f-a54f-9a0d8b8e8cd1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:04.543250 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fb28998-4721-454f-a54f-9a0d8b8e8cd1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:04.543905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fb28998-4721-454f-a54f-9a0d8b8e8cd1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:04.546976 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fb28998-4721-454f-a54f-9a0d8b8e8cd1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:04.567122 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d4098dda-bfc6-4953-8fbe-f97e85e2e1c1 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:04.568718 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d4098dda-bfc6-4953-8fbe-f97e85e2e1c1 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:04.582147 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d4098dda-bfc6-4953-8fbe-f97e85e2e1c1 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:04.582939 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d4098dda-bfc6-4953-8fbe-f97e85e2e1c1 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:04.584082 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d4098dda-bfc6-4953-8fbe-f97e85e2e1c1 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:04.584833 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d4098dda-bfc6-4953-8fbe-f97e85e2e1c1 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:04.776374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2fb28998-4721-454f-a54f-9a0d8b8e8cd1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:04.783952 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d4098dda-bfc6-4953-8fbe-f97e85e2e1c1 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:04.804749 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2fb28998-4721-454f-a54f-9a0d8b8e8cd1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.273978 Aug 01 14:09:04.804749 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 52/99] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:04 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:04.810602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6e12aa9d-4509-4044-9edd-f1301d67f83b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:04.810602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6e12aa9d-4509-4044-9edd-f1301d67f83b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:04.815944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d4098dda-bfc6-4953-8fbe-f97e85e2e1c1 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.254025 Aug 01 14:09:04.818140 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 48/100] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:04 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:04.818631 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e12aa9d-4509-4044-9edd-f1301d67f83b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:04.819103 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e12aa9d-4509-4044-9edd-f1301d67f83b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:04.820007 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e12aa9d-4509-4044-9edd-f1301d67f83b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:04.820380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e12aa9d-4509-4044-9edd-f1301d67f83b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:04.974304 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6e12aa9d-4509-4044-9edd-f1301d67f83b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:04.982954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6e12aa9d-4509-4044-9edd-f1301d67f83b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.178021 Aug 01 14:09:04.982954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 53/101] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:04 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:05.828738 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-206e4e3e-efc8-4f68-bd08-f12e8b97bad5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:05.829686 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-206e4e3e-efc8-4f68-bd08-f12e8b97bad5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:05.840181 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-206e4e3e-efc8-4f68-bd08-f12e8b97bad5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:05.845885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-adf8f02b-3997-4b30-bd39-4da6f37a3483 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:05.846534 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-adf8f02b-3997-4b30-bd39-4da6f37a3483 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:05.851908 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-206e4e3e-efc8-4f68-bd08-f12e8b97bad5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:05.853562 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-206e4e3e-efc8-4f68-bd08-f12e8b97bad5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:05.853996 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-206e4e3e-efc8-4f68-bd08-f12e8b97bad5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:05.858144 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-adf8f02b-3997-4b30-bd39-4da6f37a3483 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:05.858609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-adf8f02b-3997-4b30-bd39-4da6f37a3483 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:05.859388 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-adf8f02b-3997-4b30-bd39-4da6f37a3483 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:05.859830 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-adf8f02b-3997-4b30-bd39-4da6f37a3483 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:06.133494 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-206e4e3e-efc8-4f68-bd08-f12e8b97bad5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:06.145729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-adf8f02b-3997-4b30-bd39-4da6f37a3483 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:06.147614 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-206e4e3e-efc8-4f68-bd08-f12e8b97bad5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.325568 Aug 01 14:09:06.148398 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 49/102] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:05 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:06.160710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-adf8f02b-3997-4b30-bd39-4da6f37a3483 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.315980 Aug 01 14:09:06.160710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 54/103] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:05 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:06.189643 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-56917579-fa8d-407a-a9ba-ed692811e6ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:06.189643 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-56917579-fa8d-407a-a9ba-ed692811e6ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:06.202880 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-56917579-fa8d-407a-a9ba-ed692811e6ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:06.204482 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-56917579-fa8d-407a-a9ba-ed692811e6ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:06.206417 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-56917579-fa8d-407a-a9ba-ed692811e6ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:06.206845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-56917579-fa8d-407a-a9ba-ed692811e6ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:06.626332 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-56917579-fa8d-407a-a9ba-ed692811e6ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:06.642279 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-56917579-fa8d-407a-a9ba-ed692811e6ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.468865 Aug 01 14:09:06.642895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 55/104] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:06 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:07.170597 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9f9f505b-3808-4b3f-aa72-f78e122fc7c0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:07.171899 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-9f9f505b-3808-4b3f-aa72-f78e122fc7c0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:07.184107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3aaff19c-e7ec-4184-90c7-8aeecb731199 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:07.186201 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3aaff19c-e7ec-4184-90c7-8aeecb731199 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:07.191976 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9f9f505b-3808-4b3f-aa72-f78e122fc7c0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:07.192475 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9f9f505b-3808-4b3f-aa72-f78e122fc7c0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:07.193297 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9f9f505b-3808-4b3f-aa72-f78e122fc7c0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:07.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9f9f505b-3808-4b3f-aa72-f78e122fc7c0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:07.204792 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3aaff19c-e7ec-4184-90c7-8aeecb731199 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:07.205597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3aaff19c-e7ec-4184-90c7-8aeecb731199 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:07.206679 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3aaff19c-e7ec-4184-90c7-8aeecb731199 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:07.207679 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3aaff19c-e7ec-4184-90c7-8aeecb731199 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:08.178612 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9f9f505b-3808-4b3f-aa72-f78e122fc7c0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:08.191836 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9f9f505b-3808-4b3f-aa72-f78e122fc7c0 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 1.024995 Aug 01 14:09:08.193204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 50/105] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:07 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:08.231380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3aaff19c-e7ec-4184-90c7-8aeecb731199 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:08.243380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3aaff19c-e7ec-4184-90c7-8aeecb731199 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 1.064406 Aug 01 14:09:08.255939 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 56/106] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:07 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:08.262383 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6991c142-78c2-47cf-81bf-383d1209f018 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:08.263030 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6991c142-78c2-47cf-81bf-383d1209f018 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:08.272052 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6991c142-78c2-47cf-81bf-383d1209f018 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:08.272840 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6991c142-78c2-47cf-81bf-383d1209f018 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:08.273888 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6991c142-78c2-47cf-81bf-383d1209f018 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:08.274330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6991c142-78c2-47cf-81bf-383d1209f018 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:08.328042 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-acf12ab0-194e-47bc-8204-db71c0349cbe req-f804d53c-2118-475a-80fb-1d06ce964d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36838f66-2529-4a98-88cd-4a0450c2aba5", "name": "network-vif-plugged", "status": "completed", "tag": "6435f407-545f-4889-be82-4de3b791eeb8"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:08.376749 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-acf12ab0-194e-47bc-8204-db71c0349cbe req-f804d53c-2118-475a-80fb-1d06ce964d98 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:08.377177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-acf12ab0-194e-47bc-8204-db71c0349cbe req-f804d53c-2118-475a-80fb-1d06ce964d98 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:08.411697 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-acf12ab0-194e-47bc-8204-db71c0349cbe req-f804d53c-2118-475a-80fb-1d06ce964d98 service nova] Creating event network-vif-plugged:6435f407-545f-4889-be82-4de3b791eeb8 for instance 36838f66-2529-4a98-88cd-4a0450c2aba5 on hv-cinder-84517 Aug 01 14:09:08.429024 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-acf12ab0-194e-47bc-8204-db71c0349cbe req-f804d53c-2118-475a-80fb-1d06ce964d98 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233982 Aug 01 14:09:08.429648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 51/107] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:08.589813 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6991c142-78c2-47cf-81bf-383d1209f018 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:08.601719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6991c142-78c2-47cf-81bf-383d1209f018 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.344468 Aug 01 14:09:08.611023 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 57/108] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:08 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:09.215426 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-32216316-8022-4158-9634-44c7e1648e97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:09.216973 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-32216316-8022-4158-9634-44c7e1648e97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:09.239442 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32216316-8022-4158-9634-44c7e1648e97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.260704 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32216316-8022-4158-9634-44c7e1648e97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:09.262933 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32216316-8022-4158-9634-44c7e1648e97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.264846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32216316-8022-4158-9634-44c7e1648e97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:09.281905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-866ff57c-a4bd-4f4b-b77f-5fb0594ba84c tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:09.283465 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-866ff57c-a4bd-4f4b-b77f-5fb0594ba84c tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:09.294419 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-866ff57c-a4bd-4f4b-b77f-5fb0594ba84c tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.294796 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-866ff57c-a4bd-4f4b-b77f-5fb0594ba84c tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:09.295858 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-866ff57c-a4bd-4f4b-b77f-5fb0594ba84c tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.296322 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-866ff57c-a4bd-4f4b-b77f-5fb0594ba84c tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:09.705067 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-866ff57c-a4bd-4f4b-b77f-5fb0594ba84c tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:09.713284 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-866ff57c-a4bd-4f4b-b77f-5fb0594ba84c tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.436747 Aug 01 14:09:09.713883 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 58/109] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:09 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:09.722971 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2b36908f-94a5-47fa-b2ef-6fdcf3eddded tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:09.722971 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2b36908f-94a5-47fa-b2ef-6fdcf3eddded tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:09.726730 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b36908f-94a5-47fa-b2ef-6fdcf3eddded tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.727183 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b36908f-94a5-47fa-b2ef-6fdcf3eddded tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:09.729421 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b36908f-94a5-47fa-b2ef-6fdcf3eddded tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.729974 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b36908f-94a5-47fa-b2ef-6fdcf3eddded tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:09.735569 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-32216316-8022-4158-9634-44c7e1648e97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:09.744189 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-32216316-8022-4158-9634-44c7e1648e97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.533282 Aug 01 14:09:09.744812 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 52/110] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:09 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:09.900407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2b36908f-94a5-47fa-b2ef-6fdcf3eddded tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:09.910136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2b36908f-94a5-47fa-b2ef-6fdcf3eddded tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.195183 Aug 01 14:09:09.911231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 59/111] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:09 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:10.467623 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-2b23465e-4130-4a2a-a576-eaa9aa269cef req-f8524a3e-d6ba-4798-a6d5-502429c3f620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017caf5e-f276-4e12-9a46-cc2d666cd313", "name": "network-vif-plugged", "status": "completed", "tag": "6af8bd7d-b81c-4d73-820b-78155d3d21f6"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:10.485804 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-2b23465e-4130-4a2a-a576-eaa9aa269cef req-f8524a3e-d6ba-4798-a6d5-502429c3f620 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:10.486246 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-2b23465e-4130-4a2a-a576-eaa9aa269cef req-f8524a3e-d6ba-4798-a6d5-502429c3f620 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:10.502169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-2b23465e-4130-4a2a-a576-eaa9aa269cef req-f8524a3e-d6ba-4798-a6d5-502429c3f620 service nova] Creating event network-vif-plugged:6af8bd7d-b81c-4d73-820b-78155d3d21f6 for instance 017caf5e-f276-4e12-9a46-cc2d666cd313 on hv-cinder-84517 Aug 01 14:09:10.508902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-2b23465e-4130-4a2a-a576-eaa9aa269cef req-f8524a3e-d6ba-4798-a6d5-502429c3f620 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045031 Aug 01 14:09:10.509694 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 53/112] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:10.735633 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-59f353ed-c648-405e-a5ee-c7c6d4a5c57e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:10.736967 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-59f353ed-c648-405e-a5ee-c7c6d4a5c57e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:10.744017 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59f353ed-c648-405e-a5ee-c7c6d4a5c57e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:10.744539 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59f353ed-c648-405e-a5ee-c7c6d4a5c57e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:10.745384 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59f353ed-c648-405e-a5ee-c7c6d4a5c57e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:10.746397 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59f353ed-c648-405e-a5ee-c7c6d4a5c57e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:10.768700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6215b73f-a066-41b3-866f-f1efb8a45479 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:10.770209 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6215b73f-a066-41b3-866f-f1efb8a45479 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:10.779127 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6215b73f-a066-41b3-866f-f1efb8a45479 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:10.779876 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6215b73f-a066-41b3-866f-f1efb8a45479 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:10.780896 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6215b73f-a066-41b3-866f-f1efb8a45479 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:10.781782 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6215b73f-a066-41b3-866f-f1efb8a45479 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:10.979355 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-59f353ed-c648-405e-a5ee-c7c6d4a5c57e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:10.993002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-59f353ed-c648-405e-a5ee-c7c6d4a5c57e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.259500 Aug 01 14:09:10.994672 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 60/113] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:10 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:10.997624 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6215b73f-a066-41b3-866f-f1efb8a45479 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:11.003904 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-67391472-f633-4525-9604-3702261c6afb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:11.005277 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-67391472-f633-4525-9604-3702261c6afb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:11.007443 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6215b73f-a066-41b3-866f-f1efb8a45479 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.244027 Aug 01 14:09:11.009473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 54/114] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:10 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:11.017741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-67391472-f633-4525-9604-3702261c6afb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:11.019246 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-67391472-f633-4525-9604-3702261c6afb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:11.020384 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-67391472-f633-4525-9604-3702261c6afb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:11.021397 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-67391472-f633-4525-9604-3702261c6afb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:11.218221 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-67391472-f633-4525-9604-3702261c6afb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:11.226719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-67391472-f633-4525-9604-3702261c6afb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.230281 Aug 01 14:09:11.227311 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 61/115] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:10 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:12.027474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4ae6b393-df72-4f0b-87f4-c8a7459c6544 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:12.028646 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4ae6b393-df72-4f0b-87f4-c8a7459c6544 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:12.036318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-96ff9ddd-e088-41ff-8bd5-332e2f9b5c9b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:12.036970 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-96ff9ddd-e088-41ff-8bd5-332e2f9b5c9b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:12.045456 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4ae6b393-df72-4f0b-87f4-c8a7459c6544 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.045893 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4ae6b393-df72-4f0b-87f4-c8a7459c6544 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.046743 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4ae6b393-df72-4f0b-87f4-c8a7459c6544 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.048598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-96ff9ddd-e088-41ff-8bd5-332e2f9b5c9b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.049084 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-96ff9ddd-e088-41ff-8bd5-332e2f9b5c9b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.049922 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-96ff9ddd-e088-41ff-8bd5-332e2f9b5c9b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.050347 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-96ff9ddd-e088-41ff-8bd5-332e2f9b5c9b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.053699 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4ae6b393-df72-4f0b-87f4-c8a7459c6544 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.307707 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-96ff9ddd-e088-41ff-8bd5-332e2f9b5c9b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:12.314070 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4ae6b393-df72-4f0b-87f4-c8a7459c6544 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:12.317899 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-96ff9ddd-e088-41ff-8bd5-332e2f9b5c9b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.285507 Aug 01 14:09:12.318498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 62/116] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:12 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:12.324755 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c0a3f445-b66f-4bf0-adf3-cd7d278f6b50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:12.325645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c0a3f445-b66f-4bf0-adf3-cd7d278f6b50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:12.332917 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4ae6b393-df72-4f0b-87f4-c8a7459c6544 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.307317 Aug 01 14:09:12.333510 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0a3f445-b66f-4bf0-adf3-cd7d278f6b50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.334112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0a3f445-b66f-4bf0-adf3-cd7d278f6b50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.335002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0a3f445-b66f-4bf0-adf3-cd7d278f6b50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.335445 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0a3f445-b66f-4bf0-adf3-cd7d278f6b50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.336478 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 55/117] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:12 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:12.559001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c0a3f445-b66f-4bf0-adf3-cd7d278f6b50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:12.569540 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c0a3f445-b66f-4bf0-adf3-cd7d278f6b50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.249490 Aug 01 14:09:12.570513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 63/118] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:12 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:13.339411 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6bc3faa7-93d9-4566-ac9e-660ae4544fde tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:13.340038 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6bc3faa7-93d9-4566-ac9e-660ae4544fde tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:13.346948 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6bc3faa7-93d9-4566-ac9e-660ae4544fde tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.347399 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6bc3faa7-93d9-4566-ac9e-660ae4544fde tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.348180 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6bc3faa7-93d9-4566-ac9e-660ae4544fde tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.348657 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6bc3faa7-93d9-4566-ac9e-660ae4544fde tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.371228 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a06fe5e0-818a-47ab-a1b3-d40e28a709ac tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:13.371909 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a06fe5e0-818a-47ab-a1b3-d40e28a709ac tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:13.378821 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a06fe5e0-818a-47ab-a1b3-d40e28a709ac tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.379267 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a06fe5e0-818a-47ab-a1b3-d40e28a709ac tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.380036 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a06fe5e0-818a-47ab-a1b3-d40e28a709ac tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.380486 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a06fe5e0-818a-47ab-a1b3-d40e28a709ac tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.558320 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6bc3faa7-93d9-4566-ac9e-660ae4544fde tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:13.566602 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6bc3faa7-93d9-4566-ac9e-660ae4544fde tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.231043 Aug 01 14:09:13.567284 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 56/119] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:13 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:13.572973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a06fe5e0-818a-47ab-a1b3-d40e28a709ac tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:13.587205 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a06fe5e0-818a-47ab-a1b3-d40e28a709ac tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.219690 Aug 01 14:09:13.596823 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6493f260-4a73-4003-93d9-efc357287386 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:13.597067 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 64/120] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:13 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:13.598343 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6493f260-4a73-4003-93d9-efc357287386 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:13.608547 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6493f260-4a73-4003-93d9-efc357287386 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.609253 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6493f260-4a73-4003-93d9-efc357287386 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.610544 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6493f260-4a73-4003-93d9-efc357287386 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.611252 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6493f260-4a73-4003-93d9-efc357287386 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.788327 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6493f260-4a73-4003-93d9-efc357287386 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:13.801945 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6493f260-4a73-4003-93d9-efc357287386 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.214637 Aug 01 14:09:13.803115 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 57/121] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:13 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:14.603607 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-38d0758b-333a-4bad-af46-9431b498e6f5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:14.604312 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-38d0758b-333a-4bad-af46-9431b498e6f5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:14.611902 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-38d0758b-333a-4bad-af46-9431b498e6f5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.612579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-38d0758b-333a-4bad-af46-9431b498e6f5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.613460 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-38d0758b-333a-4bad-af46-9431b498e6f5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.613631 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-101cb21a-1bb0-4a96-a9f5-46e37cbcd51e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:14.614384 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-38d0758b-333a-4bad-af46-9431b498e6f5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.614538 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-101cb21a-1bb0-4a96-a9f5-46e37cbcd51e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:14.621530 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-101cb21a-1bb0-4a96-a9f5-46e37cbcd51e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.621958 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-101cb21a-1bb0-4a96-a9f5-46e37cbcd51e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.622739 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-101cb21a-1bb0-4a96-a9f5-46e37cbcd51e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.623169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-101cb21a-1bb0-4a96-a9f5-46e37cbcd51e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.626168 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=100 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:14.887581 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-38d0758b-333a-4bad-af46-9431b498e6f5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:14.892509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-101cb21a-1bb0-4a96-a9f5-46e37cbcd51e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:14.901716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-38d0758b-333a-4bad-af46-9431b498e6f5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.301713 Aug 01 14:09:14.902619 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 65/122] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:14 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:14.904436 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-101cb21a-1bb0-4a96-a9f5-46e37cbcd51e tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.294749 Aug 01 14:09:14.905396 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 58/123] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:14 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:14.921944 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d16ed4b2-66e1-44b6-807f-fcca6c7b33ee tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:14.923071 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d16ed4b2-66e1-44b6-807f-fcca6c7b33ee tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:14.936923 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d16ed4b2-66e1-44b6-807f-fcca6c7b33ee tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.937697 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d16ed4b2-66e1-44b6-807f-fcca6c7b33ee tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.939064 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d16ed4b2-66e1-44b6-807f-fcca6c7b33ee tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.939834 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d16ed4b2-66e1-44b6-807f-fcca6c7b33ee tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:15.138109 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d16ed4b2-66e1-44b6-807f-fcca6c7b33ee tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:15.147302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-475b00d8-d6f1-4445-93a0-ddce5e069259 req-f556d0a1-ded5-4060-98dc-60edaabecc87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8", "name": "network-vif-plugged", "status": "completed", "tag": "82f43520-38c1-414e-b0a4-66b27e6ff60b"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:15.149425 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d16ed4b2-66e1-44b6-807f-fcca6c7b33ee tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.244948 Aug 01 14:09:15.150671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 66/124] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:14 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:15.167639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-475b00d8-d6f1-4445-93a0-ddce5e069259 req-f556d0a1-ded5-4060-98dc-60edaabecc87 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:15.168465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-475b00d8-d6f1-4445-93a0-ddce5e069259 req-f556d0a1-ded5-4060-98dc-60edaabecc87 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:15.190833 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-475b00d8-d6f1-4445-93a0-ddce5e069259 req-f556d0a1-ded5-4060-98dc-60edaabecc87 service nova] Creating event network-vif-plugged:82f43520-38c1-414e-b0a4-66b27e6ff60b for instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 on hv-cinder-84517 Aug 01 14:09:15.199807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-475b00d8-d6f1-4445-93a0-ddce5e069259 req-f556d0a1-ded5-4060-98dc-60edaabecc87 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059326 Aug 01 14:09:15.201022 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 59/125] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:15.928006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fdd1343e-9951-4ba7-ae6e-c710204724da tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:15.928680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fdd1343e-9951-4ba7-ae6e-c710204724da tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:15.937197 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5061eba2-6014-454e-b496-95c4dbd4ffc8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:15.938621 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5061eba2-6014-454e-b496-95c4dbd4ffc8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:15.943284 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdd1343e-9951-4ba7-ae6e-c710204724da tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:15.943914 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdd1343e-9951-4ba7-ae6e-c710204724da tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:15.944907 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdd1343e-9951-4ba7-ae6e-c710204724da tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:15.945482 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdd1343e-9951-4ba7-ae6e-c710204724da tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:15.947376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5061eba2-6014-454e-b496-95c4dbd4ffc8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:15.948225 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5061eba2-6014-454e-b496-95c4dbd4ffc8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:15.949239 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5061eba2-6014-454e-b496-95c4dbd4ffc8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:15.949847 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5061eba2-6014-454e-b496-95c4dbd4ffc8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:15.971369 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:16.203402 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5061eba2-6014-454e-b496-95c4dbd4ffc8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:16.215039 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fdd1343e-9951-4ba7-ae6e-c710204724da tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:16.225265 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5061eba2-6014-454e-b496-95c4dbd4ffc8 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.292634 Aug 01 14:09:16.225863 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 60/126] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:15 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:16.228630 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fdd1343e-9951-4ba7-ae6e-c710204724da tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.304358 Aug 01 14:09:16.231163 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 67/127] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:15 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:16.235886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-22cede47-d3f5-421a-bfe9-ffe34b4690ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:16.239655 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-22cede47-d3f5-421a-bfe9-ffe34b4690ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:16.257658 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-22cede47-d3f5-421a-bfe9-ffe34b4690ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:16.257965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-22cede47-d3f5-421a-bfe9-ffe34b4690ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:16.258917 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-22cede47-d3f5-421a-bfe9-ffe34b4690ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:16.259331 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-22cede47-d3f5-421a-bfe9-ffe34b4690ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:16.513547 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-22cede47-d3f5-421a-bfe9-ffe34b4690ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:16.524837 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-22cede47-d3f5-421a-bfe9-ffe34b4690ca tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.293861 Aug 01 14:09:16.539137 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 61/128] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:16 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:17.251849 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e20da79c-efcb-4567-9cd2-a6bad9600d87 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:17.254259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e20da79c-efcb-4567-9cd2-a6bad9600d87 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:17.261309 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2f3d022a-936d-4e99-8500-35e2361e09ff tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:17.268599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e20da79c-efcb-4567-9cd2-a6bad9600d87 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.269723 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e20da79c-efcb-4567-9cd2-a6bad9600d87 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.271755 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e20da79c-efcb-4567-9cd2-a6bad9600d87 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.272373 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2f3d022a-936d-4e99-8500-35e2361e09ff tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:17.273091 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e20da79c-efcb-4567-9cd2-a6bad9600d87 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.309387 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2f3d022a-936d-4e99-8500-35e2361e09ff tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.313342 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2f3d022a-936d-4e99-8500-35e2361e09ff tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.321708 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2f3d022a-936d-4e99-8500-35e2361e09ff tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.322612 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2f3d022a-936d-4e99-8500-35e2361e09ff tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.701877 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e20da79c-efcb-4567-9cd2-a6bad9600d87 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:17.705915 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2f3d022a-936d-4e99-8500-35e2361e09ff tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:17.714873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e20da79c-efcb-4567-9cd2-a6bad9600d87 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1314 microversion: 2.1 time: 0.470300 Aug 01 14:09:17.726626 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2f3d022a-936d-4e99-8500-35e2361e09ff tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1363 microversion: 2.1 time: 0.462609 Aug 01 14:09:17.726626 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 62/129] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:17 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:17.728321 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 68/130] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:17 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:17.733582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-90fac6a2-1157-424a-b4e0-245bf98c6ef1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:17.734944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-90fac6a2-1157-424a-b4e0-245bf98c6ef1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:17.744175 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90fac6a2-1157-424a-b4e0-245bf98c6ef1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.745058 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90fac6a2-1157-424a-b4e0-245bf98c6ef1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.746158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90fac6a2-1157-424a-b4e0-245bf98c6ef1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.746984 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90fac6a2-1157-424a-b4e0-245bf98c6ef1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.009061 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-90fac6a2-1157-424a-b4e0-245bf98c6ef1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:18.020215 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-90fac6a2-1157-424a-b4e0-245bf98c6ef1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.303048 Aug 01 14:09:18.033315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 63/131] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:17 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:18.759970 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9d5a6dfa-a76c-4db4-b128-9bb23dac048f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:18.759970 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-9d5a6dfa-a76c-4db4-b128-9bb23dac048f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:18.766015 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6215a6ac-6f87-4ae5-80c3-67201910a8dc tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:18.767121 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6215a6ac-6f87-4ae5-80c3-67201910a8dc tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:18.787484 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9d5a6dfa-a76c-4db4-b128-9bb23dac048f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.789229 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9d5a6dfa-a76c-4db4-b128-9bb23dac048f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.790248 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9d5a6dfa-a76c-4db4-b128-9bb23dac048f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.790755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9d5a6dfa-a76c-4db4-b128-9bb23dac048f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.791519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6215a6ac-6f87-4ae5-80c3-67201910a8dc tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.792580 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6215a6ac-6f87-4ae5-80c3-67201910a8dc tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.794031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6215a6ac-6f87-4ae5-80c3-67201910a8dc tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.795237 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6215a6ac-6f87-4ae5-80c3-67201910a8dc tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.344364 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6215a6ac-6f87-4ae5-80c3-67201910a8dc tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:19.358127 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6215a6ac-6f87-4ae5-80c3-67201910a8dc tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1501 microversion: 2.1 time: 0.609391 Aug 01 14:09:19.364136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 69/132] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:18 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1501 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:19.372667 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1bd4d788-bbb9-4fb2-8529-29ea2efa4c66 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:19.373285 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1bd4d788-bbb9-4fb2-8529-29ea2efa4c66 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:19.400602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1bd4d788-bbb9-4fb2-8529-29ea2efa4c66 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.400602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1bd4d788-bbb9-4fb2-8529-29ea2efa4c66 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.400602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1bd4d788-bbb9-4fb2-8529-29ea2efa4c66 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.400602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1bd4d788-bbb9-4fb2-8529-29ea2efa4c66 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.465771 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9d5a6dfa-a76c-4db4-b128-9bb23dac048f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:19.472336 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9d5a6dfa-a76c-4db4-b128-9bb23dac048f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1549 microversion: 2.1 time: 0.720598 Aug 01 14:09:19.477931 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 64/133] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:18 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1549 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:19.514194 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-4cfad880-d9e2-4283-8d50-a944cdc71417 req-b65e9d9b-b02d-4ad3-87d3-5133a2b3845c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa86ccd-b145-4025-88ba-1962fcddee29", "name": "network-vif-plugged", "status": "completed", "tag": "7086f705-ac19-4c95-a617-0872f904d724"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:19.568796 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-4cfad880-d9e2-4283-8d50-a944cdc71417 req-b65e9d9b-b02d-4ad3-87d3-5133a2b3845c service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.569595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-4cfad880-d9e2-4283-8d50-a944cdc71417 req-b65e9d9b-b02d-4ad3-87d3-5133a2b3845c service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.611049 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-4cfad880-d9e2-4283-8d50-a944cdc71417 req-b65e9d9b-b02d-4ad3-87d3-5133a2b3845c service nova] Creating event network-vif-plugged:7086f705-ac19-4c95-a617-0872f904d724 for instance 2fa86ccd-b145-4025-88ba-1962fcddee29 on hv-cinder-84517 Aug 01 14:09:19.626337 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-4cfad880-d9e2-4283-8d50-a944cdc71417 req-b65e9d9b-b02d-4ad3-87d3-5133a2b3845c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122516 Aug 01 14:09:19.635649 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 65/134] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:19.655813 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-87d3eccb-a9f4-4cd0-8857-22c708e932f9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:19.661952 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-87d3eccb-a9f4-4cd0-8857-22c708e932f9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:19.695394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-87d3eccb-a9f4-4cd0-8857-22c708e932f9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.700574 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-87d3eccb-a9f4-4cd0-8857-22c708e932f9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.702400 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-87d3eccb-a9f4-4cd0-8857-22c708e932f9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.706409 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-87d3eccb-a9f4-4cd0-8857-22c708e932f9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.983987 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1bd4d788-bbb9-4fb2-8529-29ea2efa4c66 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:20.037999 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1bd4d788-bbb9-4fb2-8529-29ea2efa4c66 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 0.670946 Aug 01 14:09:20.039995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 70/135] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:19 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:20.314266 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-87d3eccb-a9f4-4cd0-8857-22c708e932f9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.675724 Aug 01 14:09:20.315800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 66/136] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 14:09:19 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/os-interface => generated 284 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:21.086675 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-afa7eec3-dc0e-4cb1-9aec-c5f6afe822f2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:21.090674 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-afa7eec3-dc0e-4cb1-9aec-c5f6afe822f2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:21.145770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afa7eec3-dc0e-4cb1-9aec-c5f6afe822f2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.147634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afa7eec3-dc0e-4cb1-9aec-c5f6afe822f2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.152169 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afa7eec3-dc0e-4cb1-9aec-c5f6afe822f2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.154980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afa7eec3-dc0e-4cb1-9aec-c5f6afe822f2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.864241 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-e6c796e8-565a-4313-9c3e-2e77808efe66 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "995dc6d9-cb2e-49b3-8554-8dcd56b6269d"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:21.871923 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-e6c796e8-565a-4313-9c3e-2e77808efe66 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:21.880388 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e6c796e8-565a-4313-9c3e-2e77808efe66 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.880937 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e6c796e8-565a-4313-9c3e-2e77808efe66 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.881868 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e6c796e8-565a-4313-9c3e-2e77808efe66 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.895035 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e6c796e8-565a-4313-9c3e-2e77808efe66 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:22.722161 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-afa7eec3-dc0e-4cb1-9aec-c5f6afe822f2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:22.757769 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-afa7eec3-dc0e-4cb1-9aec-c5f6afe822f2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1321 microversion: 2.1 time: 1.681446 Aug 01 14:09:22.773987 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 71/137] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:21 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1321 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:23.229052 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-e6c796e8-565a-4313-9c3e-2e77808efe66 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "POST /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.373715 Aug 01 14:09:23.231949 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 67/138] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:09:21 2022] POST /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313/os-volume_attachments => generated 194 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:23.797133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-53036613-8849-443b-9a88-455d9d5f109a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:23.798837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-53036613-8849-443b-9a88-455d9d5f109a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:23.812056 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53036613-8849-443b-9a88-455d9d5f109a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:23.814254 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53036613-8849-443b-9a88-455d9d5f109a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:23.816405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53036613-8849-443b-9a88-455d9d5f109a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:23.817711 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53036613-8849-443b-9a88-455d9d5f109a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.197350 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-53036613-8849-443b-9a88-455d9d5f109a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:24.260003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-53036613-8849-443b-9a88-455d9d5f109a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1515 microversion: 2.1 time: 0.466529 Aug 01 14:09:24.263235 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 72/139] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:23 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1515 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:24.274867 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-7883942d-06c2-45bf-8491-444cb07249db req-4b2a5027-8832-49f2-8c65-14628cab7a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8", "tag": "82f43520-38c1-414e-b0a4-66b27e6ff60b"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:24.318135 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ecd03d08-9cf6-47f6-85aa-0e07529a5a43 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:24.319364 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-7883942d-06c2-45bf-8491-444cb07249db req-4b2a5027-8832-49f2-8c65-14628cab7a1e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.319807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-7883942d-06c2-45bf-8491-444cb07249db req-4b2a5027-8832-49f2-8c65-14628cab7a1e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.325953 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ecd03d08-9cf6-47f6-85aa-0e07529a5a43 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:24.346507 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecd03d08-9cf6-47f6-85aa-0e07529a5a43 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.351313 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecd03d08-9cf6-47f6-85aa-0e07529a5a43 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.357909 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecd03d08-9cf6-47f6-85aa-0e07529a5a43 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.359039 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecd03d08-9cf6-47f6-85aa-0e07529a5a43 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.396364 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-7883942d-06c2-45bf-8491-444cb07249db req-4b2a5027-8832-49f2-8c65-14628cab7a1e service nova] Creating event network-changed:82f43520-38c1-414e-b0a4-66b27e6ff60b for instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 on hv-cinder-84517 Aug 01 14:09:24.406111 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-7883942d-06c2-45bf-8491-444cb07249db req-4b2a5027-8832-49f2-8c65-14628cab7a1e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134874 Aug 01 14:09:24.426479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 68/140] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:24.667704 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-ecd03d08-9cf6-47f6-85aa-0e07529a5a43 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lazy-loading 'flavor' on Instance uuid 2fa86ccd-b145-4025-88ba-1962fcddee29 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:09:25.207565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ecd03d08-9cf6-47f6-85aa-0e07529a5a43 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29/action" status: 200 len: 32 microversion: 2.1 time: 0.908083 Aug 01 14:09:25.229906 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 73/141] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:09:24 2022] POST /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29/action => generated 32 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:09:25.257486 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c367a815-62d1-4335-b14e-a426b0aa6bc8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:25.268318 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c367a815-62d1-4335-b14e-a426b0aa6bc8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:25.332394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c367a815-62d1-4335-b14e-a426b0aa6bc8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.341476 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c367a815-62d1-4335-b14e-a426b0aa6bc8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:25.343369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c367a815-62d1-4335-b14e-a426b0aa6bc8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.354786 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c367a815-62d1-4335-b14e-a426b0aa6bc8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:26.007440 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c367a815-62d1-4335-b14e-a426b0aa6bc8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:26.029724 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c367a815-62d1-4335-b14e-a426b0aa6bc8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.790830 Aug 01 14:09:26.031439 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 69/142] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:25 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:27.071916 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-51da7eb6-a93b-4c78-9ddf-2e8ed0ae526a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:27.078062 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-51da7eb6-a93b-4c78-9ddf-2e8ed0ae526a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:27.100640 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=62 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:27.108684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51da7eb6-a93b-4c78-9ddf-2e8ed0ae526a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:27.111934 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51da7eb6-a93b-4c78-9ddf-2e8ed0ae526a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:27.117440 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51da7eb6-a93b-4c78-9ddf-2e8ed0ae526a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:27.122803 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51da7eb6-a93b-4c78-9ddf-2e8ed0ae526a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:27.563783 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-51da7eb6-a93b-4c78-9ddf-2e8ed0ae526a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:27.577749 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-51da7eb6-a93b-4c78-9ddf-2e8ed0ae526a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.520635 Aug 01 14:09:27.593228 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 74/143] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:27 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:28.611378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-dad4b776-b985-4277-b383-31244ad6d347 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:28.612879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-dad4b776-b985-4277-b383-31244ad6d347 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:28.620850 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=60 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:28.623218 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dad4b776-b985-4277-b383-31244ad6d347 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:28.623863 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dad4b776-b985-4277-b383-31244ad6d347 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:28.624914 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dad4b776-b985-4277-b383-31244ad6d347 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:28.626335 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dad4b776-b985-4277-b383-31244ad6d347 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:28.841126 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-dad4b776-b985-4277-b383-31244ad6d347 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:28.856611 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-dad4b776-b985-4277-b383-31244ad6d347 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.250066 Aug 01 14:09:28.861402 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 70/144] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:28 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:29.909175 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4066895d-6969-41a6-81cc-a3b896b386f7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:29.909707 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4066895d-6969-41a6-81cc-a3b896b386f7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:29.917348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4066895d-6969-41a6-81cc-a3b896b386f7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:29.917860 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4066895d-6969-41a6-81cc-a3b896b386f7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:29.918634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4066895d-6969-41a6-81cc-a3b896b386f7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:29.919066 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4066895d-6969-41a6-81cc-a3b896b386f7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:30.331577 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4066895d-6969-41a6-81cc-a3b896b386f7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:30.349274 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4066895d-6969-41a6-81cc-a3b896b386f7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.440394 Aug 01 14:09:30.361124 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 75/145] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:29 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:31.394737 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c25f40af-f58c-424f-8a6d-c95ed059f26b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:31.395618 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c25f40af-f58c-424f-8a6d-c95ed059f26b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:31.406390 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c25f40af-f58c-424f-8a6d-c95ed059f26b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:31.407503 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c25f40af-f58c-424f-8a6d-c95ed059f26b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:31.408770 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c25f40af-f58c-424f-8a6d-c95ed059f26b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:31.409713 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c25f40af-f58c-424f-8a6d-c95ed059f26b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:31.734447 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c25f40af-f58c-424f-8a6d-c95ed059f26b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:31.749450 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c25f40af-f58c-424f-8a6d-c95ed059f26b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.358999 Aug 01 14:09:31.765660 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 71/146] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:31 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:32.772940 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-86765e76-e02b-41a3-8504-07600d2c09b0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:32.773752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-86765e76-e02b-41a3-8504-07600d2c09b0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:32.782682 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-86765e76-e02b-41a3-8504-07600d2c09b0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.783229 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-86765e76-e02b-41a3-8504-07600d2c09b0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.784374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-86765e76-e02b-41a3-8504-07600d2c09b0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.784847 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-86765e76-e02b-41a3-8504-07600d2c09b0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.803237 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a688f02a-3714-4a53-857f-beefc8852f15 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:32.804022 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a688f02a-3714-4a53-857f-beefc8852f15 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:32.811696 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a688f02a-3714-4a53-857f-beefc8852f15 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.815111 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a688f02a-3714-4a53-857f-beefc8852f15 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.816728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a688f02a-3714-4a53-857f-beefc8852f15 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.817491 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a688f02a-3714-4a53-857f-beefc8852f15 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.848799 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a688f02a-3714-4a53-857f-beefc8852f15 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:09:32.977077 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a688f02a-3714-4a53-857f-beefc8852f15 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "DELETE /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 204 len: 0 microversion: 2.1 time: 0.179556 Aug 01 14:09:32.977693 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 72/147] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:09:32 2022] DELETE /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:32.986520 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-644591a9-faad-4d94-af0d-011294b9b6cb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:32.987353 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-644591a9-faad-4d94-af0d-011294b9b6cb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:32.994329 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-644591a9-faad-4d94-af0d-011294b9b6cb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.995080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-644591a9-faad-4d94-af0d-011294b9b6cb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.996415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-644591a9-faad-4d94-af0d-011294b9b6cb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.997190 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-644591a9-faad-4d94-af0d-011294b9b6cb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:33.226287 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-86765e76-e02b-41a3-8504-07600d2c09b0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:33.242020 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-86765e76-e02b-41a3-8504-07600d2c09b0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.473345 Aug 01 14:09:33.257021 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 76/148] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:32 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:33.364446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-644591a9-faad-4d94-af0d-011294b9b6cb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:33.383050 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-644591a9-faad-4d94-af0d-011294b9b6cb tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1553 microversion: 2.1 time: 0.400270 Aug 01 14:09:33.395733 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 73/149] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:32 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1553 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:34.266693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3757a820-c4d6-4a18-93f5-949fc69bc9c5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:34.267844 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3757a820-c4d6-4a18-93f5-949fc69bc9c5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:34.281104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3757a820-c4d6-4a18-93f5-949fc69bc9c5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.281702 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3757a820-c4d6-4a18-93f5-949fc69bc9c5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.282610 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3757a820-c4d6-4a18-93f5-949fc69bc9c5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.283128 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3757a820-c4d6-4a18-93f5-949fc69bc9c5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.421126 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-04320e93-4782-4463-96de-86fb98ba3985 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:34.425400 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-04320e93-4782-4463-96de-86fb98ba3985 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:34.438993 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04320e93-4782-4463-96de-86fb98ba3985 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.440210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04320e93-4782-4463-96de-86fb98ba3985 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.445918 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04320e93-4782-4463-96de-86fb98ba3985 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.447255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04320e93-4782-4463-96de-86fb98ba3985 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.484903 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.512358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3757a820-c4d6-4a18-93f5-949fc69bc9c5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:34.551363 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3757a820-c4d6-4a18-93f5-949fc69bc9c5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.288939 Aug 01 14:09:34.565070 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 77/150] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:34 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:34.678937 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-04320e93-4782-4463-96de-86fb98ba3985 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:34.690547 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-04320e93-4782-4463-96de-86fb98ba3985 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1553 microversion: 2.1 time: 0.277252 Aug 01 14:09:34.692325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 74/151] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:34 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1553 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:35.587465 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3571a525-75f4-408d-ad00-6d1c09bda416 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:35.588577 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3571a525-75f4-408d-ad00-6d1c09bda416 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:35.598977 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3571a525-75f4-408d-ad00-6d1c09bda416 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.599482 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3571a525-75f4-408d-ad00-6d1c09bda416 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.600448 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3571a525-75f4-408d-ad00-6d1c09bda416 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.601075 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3571a525-75f4-408d-ad00-6d1c09bda416 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.718394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4132fe9c-659b-486f-83a5-b18a134fe4d7 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:35.719480 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4132fe9c-659b-486f-83a5-b18a134fe4d7 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:35.738538 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4132fe9c-659b-486f-83a5-b18a134fe4d7 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.739684 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4132fe9c-659b-486f-83a5-b18a134fe4d7 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.741166 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4132fe9c-659b-486f-83a5-b18a134fe4d7 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.741911 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4132fe9c-659b-486f-83a5-b18a134fe4d7 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.817013 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3571a525-75f4-408d-ad00-6d1c09bda416 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:35.830594 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3571a525-75f4-408d-ad00-6d1c09bda416 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.249475 Aug 01 14:09:35.831771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 78/152] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:35 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:35.989975 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4132fe9c-659b-486f-83a5-b18a134fe4d7 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:36.004647 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4132fe9c-659b-486f-83a5-b18a134fe4d7 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1553 microversion: 2.1 time: 0.293896 Aug 01 14:09:36.005720 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 75/153] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:35 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:36.587065 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-2ad3e906-033e-4367-8699-ef6d9a041f55 req-ee8ff8a9-032e-45fb-ae6d-42aa2cac7627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017caf5e-f276-4e12-9a46-cc2d666cd313", "name": "network-vif-deleted", "tag": "6af8bd7d-b81c-4d73-820b-78155d3d21f6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:36.631441 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-2ad3e906-033e-4367-8699-ef6d9a041f55 req-ee8ff8a9-032e-45fb-ae6d-42aa2cac7627 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:36.632439 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-2ad3e906-033e-4367-8699-ef6d9a041f55 req-ee8ff8a9-032e-45fb-ae6d-42aa2cac7627 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:36.657570 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-2ad3e906-033e-4367-8699-ef6d9a041f55 req-ee8ff8a9-032e-45fb-ae6d-42aa2cac7627 service nova] Creating event network-vif-deleted:6af8bd7d-b81c-4d73-820b-78155d3d21f6 for instance 017caf5e-f276-4e12-9a46-cc2d666cd313 on hv-cinder-84517 Aug 01 14:09:36.666321 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-2ad3e906-033e-4367-8699-ef6d9a041f55 req-ee8ff8a9-032e-45fb-ae6d-42aa2cac7627 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091144 Aug 01 14:09:36.667257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 79/154] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:36.860732 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b1b0a6cc-e342-4e3b-b750-7cf4a7094fa0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:36.863054 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b1b0a6cc-e342-4e3b-b750-7cf4a7094fa0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:36.875429 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1b0a6cc-e342-4e3b-b750-7cf4a7094fa0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:36.876424 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1b0a6cc-e342-4e3b-b750-7cf4a7094fa0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:36.877719 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1b0a6cc-e342-4e3b-b750-7cf4a7094fa0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:36.878805 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1b0a6cc-e342-4e3b-b750-7cf4a7094fa0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:37.031930 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8af52607-f8c1-4b0c-b51b-73cb5b857014 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:37.033093 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8af52607-f8c1-4b0c-b51b-73cb5b857014 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:37.045592 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8af52607-f8c1-4b0c-b51b-73cb5b857014 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:37.046252 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8af52607-f8c1-4b0c-b51b-73cb5b857014 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:37.046947 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8af52607-f8c1-4b0c-b51b-73cb5b857014 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:37.047381 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8af52607-f8c1-4b0c-b51b-73cb5b857014 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:37.193941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b1b0a6cc-e342-4e3b-b750-7cf4a7094fa0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:37.218031 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b1b0a6cc-e342-4e3b-b750-7cf4a7094fa0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.362598 Aug 01 14:09:37.221254 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 76/155] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:36 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:37.258688 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8af52607-f8c1-4b0c-b51b-73cb5b857014 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e0b24487342c1a9246579c0854653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e439a5de54261b5357fe8c513e9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:37.292589 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8af52607-f8c1-4b0c-b51b-73cb5b857014 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 200 len: 1345 microversion: 2.1 time: 0.268840 Aug 01 14:09:37.294318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 80/156] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:37 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 1345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:38.254586 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-378c62d5-c20b-42e0-a6da-0f8cd34d9efc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:38.255936 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-378c62d5-c20b-42e0-a6da-0f8cd34d9efc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:38.270416 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-378c62d5-c20b-42e0-a6da-0f8cd34d9efc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.271555 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-378c62d5-c20b-42e0-a6da-0f8cd34d9efc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.273422 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-378c62d5-c20b-42e0-a6da-0f8cd34d9efc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.274857 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-378c62d5-c20b-42e0-a6da-0f8cd34d9efc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.340714 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:38.342079 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:38.355683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.356710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.358170 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.359811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.394584 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] HTTP exception thrown: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Request method failure captured: Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 HTTP/1.1 Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595emMPizqpUtOuKfZC7oUFkTSc4uct2Hy3qawVQLhZjP9ce8o6i6gkc_w-of2Slfpwazp617ErOEB7jP9JIyIYmuWBEE-O5Wh2QvSGuVb7N8IPClC19c9aXFAv1QQWNdTb-HSy0vGfLBBRCsKWmCYKzm0CYg3mlidAkYsclEWKieaI Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 075e439a5de54261b5357fe8c513e9ee Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:09:38.405598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_075e439a5de54261b5357fe8c513e9ee", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/075e439a5de54261b5357fe8c513e9ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/075e439a5de54261b5357fe8c513e9ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/075e439a5de54261b5357fe8c513e9ee"}]}] Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 075e439a5de54261b5357fe8c513e9ee Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-DeleteServersTestJSON-2002377872-project Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: ed6e0b24487342c1a9246579c0854653 Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-DeleteServersTestJSON-2002377872-project Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.409894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '017caf5e-f276-4e12-9a46-cc2d666cd313'} Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:38.413188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.420736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.426941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Returning 404 to user: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:38.426941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0515a758-428a-4055-8763-44106506c51d tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 404 len: 111 microversion: 2.1 time: 0.080729 Aug 01 14:09:38.426941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 81/157] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:38 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:09:38.555288 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-378c62d5-c20b-42e0-a6da-0f8cd34d9efc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:38.561267 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:38.564485 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-378c62d5-c20b-42e0-a6da-0f8cd34d9efc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.318865 Aug 01 14:09:38.565242 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:38.565920 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 77/158] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:38 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:38.587247 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.588188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.589092 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.589679 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.617033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] HTTP exception thrown: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Request method failure captured: Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313/os-volume_attachments HTTP/1.1 Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595emMPizqpUtOuKfZC7oUFkTSc4uct2Hy3qawVQLhZjP9ce8o6i6gkc_w-of2Slfpwazp617ErOEB7jP9JIyIYmuWBEE-O5Wh2QvSGuVb7N8IPClC19c9aXFAv1QQWNdTb-HSy0vGfLBBRCsKWmCYKzm0CYg3mlidAkYsclEWKieaI Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 075e439a5de54261b5357fe8c513e9ee Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:09:38.620547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_075e439a5de54261b5357fe8c513e9ee", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/075e439a5de54261b5357fe8c513e9ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/075e439a5de54261b5357fe8c513e9ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/075e439a5de54261b5357fe8c513e9ee"}]}] Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 075e439a5de54261b5357fe8c513e9ee Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-DeleteServersTestJSON-2002377872-project Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: ed6e0b24487342c1a9246579c0854653 Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-DeleteServersTestJSON-2002377872-project Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.622209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'server_id': '017caf5e-f276-4e12-9a46-cc2d666cd313'} Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:38.622861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:38.624420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:38.626426 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Returning 404 to user: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:38.626426 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2d1a0e46-3e5b-449e-acbe-d9634963ad85 tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067414 Aug 01 14:09:38.630097 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 82/159] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:09:38 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313/os-volume_attachments => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:09:39.591254 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-52af9c3d-0ee0-405a-97c8-11c3a1afce6b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:39.592467 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-52af9c3d-0ee0-405a-97c8-11c3a1afce6b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:39.603912 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-52af9c3d-0ee0-405a-97c8-11c3a1afce6b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.604676 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-52af9c3d-0ee0-405a-97c8-11c3a1afce6b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.605971 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-52af9c3d-0ee0-405a-97c8-11c3a1afce6b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.606675 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-52af9c3d-0ee0-405a-97c8-11c3a1afce6b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.836748 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-52af9c3d-0ee0-405a-97c8-11c3a1afce6b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:39.847011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-52af9c3d-0ee0-405a-97c8-11c3a1afce6b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.262413 Aug 01 14:09:39.847802 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 78/160] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:39 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:39.984245 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:39.985591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:39.992843 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.993441 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.994499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.995151 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.015697 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] HTTP exception thrown: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Request method failure captured: Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 HTTP/1.1 Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595emMPizqpUtOuKfZC7oUFkTSc4uct2Hy3qawVQLhZjP9ce8o6i6gkc_w-of2Slfpwazp617ErOEB7jP9JIyIYmuWBEE-O5Wh2QvSGuVb7N8IPClC19c9aXFAv1QQWNdTb-HSy0vGfLBBRCsKWmCYKzm0CYg3mlidAkYsclEWKieaI Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 075e439a5de54261b5357fe8c513e9ee Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:09:40.017503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_075e439a5de54261b5357fe8c513e9ee", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/075e439a5de54261b5357fe8c513e9ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/075e439a5de54261b5357fe8c513e9ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/075e439a5de54261b5357fe8c513e9ee"}]}] Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 075e439a5de54261b5357fe8c513e9ee Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-DeleteServersTestJSON-2002377872-project Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: ed6e0b24487342c1a9246579c0854653 Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-DeleteServersTestJSON-2002377872-project Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.019895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '017caf5e-f276-4e12-9a46-cc2d666cd313'} Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:40.021193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.023288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.025298 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Returning 404 to user: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:40.025298 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cd0a4d50-fb02-44fc-a016-c142705f417b tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "DELETE /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 404 len: 111 microversion: 2.1 time: 0.040198 Aug 01 14:09:40.025298 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 83/161] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:09:39 2022] DELETE /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:09:40.035613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:40.036747 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] [instance: 017caf5e-f276-4e12-9a46-cc2d666cd313] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:40.048613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.049367 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.051955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.053146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.087546 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] HTTP exception thrown: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Request method failure captured: Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 HTTP/1.1 Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi595emMPizqpUtOuKfZC7oUFkTSc4uct2Hy3qawVQLhZjP9ce8o6i6gkc_w-of2Slfpwazp617ErOEB7jP9JIyIYmuWBEE-O5Wh2QvSGuVb7N8IPClC19c9aXFAv1QQWNdTb-HSy0vGfLBBRCsKWmCYKzm0CYg3mlidAkYsclEWKieaI Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 075e439a5de54261b5357fe8c513e9ee Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:09:40.112582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_075e439a5de54261b5357fe8c513e9ee", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/075e439a5de54261b5357fe8c513e9ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/075e439a5de54261b5357fe8c513e9ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/075e439a5de54261b5357fe8c513e9ee"}]}] Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 075e439a5de54261b5357fe8c513e9ee Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-DeleteServersTestJSON-2002377872 Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-DeleteServersTestJSON-2002377872-project Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: ed6e0b24487342c1a9246579c0854653 Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-DeleteServersTestJSON-2002377872-project Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.115740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '017caf5e-f276-4e12-9a46-cc2d666cd313'} Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:40.118099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. Aug 01 14:09:40.120890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:09:40.123492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] Returning 404 to user: Instance 017caf5e-f276-4e12-9a46-cc2d666cd313 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:40.123492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-86673713-d299-4a31-86c2-d99f732a848f tempest-DeleteServersTestJSON-2002377872 tempest-DeleteServersTestJSON-2002377872-project] 10.222.0.45 "GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313" status: 404 len: 111 microversion: 2.1 time: 0.090908 Aug 01 14:09:40.130660 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 79/162] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:40 2022] GET /compute/v2.1/servers/017caf5e-f276-4e12-9a46-cc2d666cd313 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:09:40.886207 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-83d10db5-9ca7-4692-9476-2b35a26c970f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:40.887437 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-83d10db5-9ca7-4692-9476-2b35a26c970f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:40.899331 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83d10db5-9ca7-4692-9476-2b35a26c970f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.900164 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83d10db5-9ca7-4692-9476-2b35a26c970f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.901487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83d10db5-9ca7-4692-9476-2b35a26c970f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.902285 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83d10db5-9ca7-4692-9476-2b35a26c970f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:41.213765 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-83d10db5-9ca7-4692-9476-2b35a26c970f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:41.220794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:41.236867 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-83d10db5-9ca7-4692-9476-2b35a26c970f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.357100 Aug 01 14:09:41.258750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 84/163] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:40 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:42.290850 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-036a794f-b918-4a9a-8d59-c1522532923d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:42.293982 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-036a794f-b918-4a9a-8d59-c1522532923d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:42.313012 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-036a794f-b918-4a9a-8d59-c1522532923d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:42.315093 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-036a794f-b918-4a9a-8d59-c1522532923d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:42.319520 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-036a794f-b918-4a9a-8d59-c1522532923d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:42.321142 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-036a794f-b918-4a9a-8d59-c1522532923d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:43.444324 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-036a794f-b918-4a9a-8d59-c1522532923d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:43.453156 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-036a794f-b918-4a9a-8d59-c1522532923d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 1.175627 Aug 01 14:09:43.454074 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 80/164] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:42 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:44.479419 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f2de793b-c9cb-4d94-a8c1-6f4ffdfa1f1a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:44.481141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f2de793b-c9cb-4d94-a8c1-6f4ffdfa1f1a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:44.522257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f2de793b-c9cb-4d94-a8c1-6f4ffdfa1f1a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:44.523120 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f2de793b-c9cb-4d94-a8c1-6f4ffdfa1f1a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:44.552009 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f2de793b-c9cb-4d94-a8c1-6f4ffdfa1f1a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:44.563686 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f2de793b-c9cb-4d94-a8c1-6f4ffdfa1f1a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:45.798335 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f2de793b-c9cb-4d94-a8c1-6f4ffdfa1f1a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:45.846391 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f2de793b-c9cb-4d94-a8c1-6f4ffdfa1f1a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 1.372629 Aug 01 14:09:45.852006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 85/165] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:44 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:46.887179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5a7cbf8a-76fc-47c5-a684-800191d5d0d4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:46.888065 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5a7cbf8a-76fc-47c5-a684-800191d5d0d4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:46.920133 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5a7cbf8a-76fc-47c5-a684-800191d5d0d4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:46.920619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5a7cbf8a-76fc-47c5-a684-800191d5d0d4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:46.931981 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5a7cbf8a-76fc-47c5-a684-800191d5d0d4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:46.932570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5a7cbf8a-76fc-47c5-a684-800191d5d0d4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:47.397398 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5a7cbf8a-76fc-47c5-a684-800191d5d0d4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:47.429153 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5a7cbf8a-76fc-47c5-a684-800191d5d0d4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.536187 Aug 01 14:09:47.436560 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 81/166] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:46 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:48.480148 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-edbc08e2-e70d-48e7-817b-406df0e765cb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:48.485763 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-edbc08e2-e70d-48e7-817b-406df0e765cb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:48.514599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-edbc08e2-e70d-48e7-817b-406df0e765cb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:48.515459 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-edbc08e2-e70d-48e7-817b-406df0e765cb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:48.516631 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-edbc08e2-e70d-48e7-817b-406df0e765cb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:48.517296 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-edbc08e2-e70d-48e7-817b-406df0e765cb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:49.266995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-edbc08e2-e70d-48e7-817b-406df0e765cb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:49.282356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-edbc08e2-e70d-48e7-817b-406df0e765cb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.817744 Aug 01 14:09:49.285090 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 86/167] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:48 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:50.329565 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-60b7436c-7075-4df4-9233-29cc5afe827d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:50.334471 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-60b7436c-7075-4df4-9233-29cc5afe827d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:50.374935 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-60b7436c-7075-4df4-9233-29cc5afe827d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:50.376844 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-60b7436c-7075-4df4-9233-29cc5afe827d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:50.380456 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-60b7436c-7075-4df4-9233-29cc5afe827d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:50.381237 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-60b7436c-7075-4df4-9233-29cc5afe827d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:50.840671 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-60b7436c-7075-4df4-9233-29cc5afe827d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:50.889096 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-60b7436c-7075-4df4-9233-29cc5afe827d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.566870 Aug 01 14:09:50.897702 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 82/168] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:50 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:51.946557 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f0bbe2d9-e65e-44b5-a21a-b9232be7fdf3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:51.949709 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f0bbe2d9-e65e-44b5-a21a-b9232be7fdf3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:51.987831 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0bbe2d9-e65e-44b5-a21a-b9232be7fdf3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:51.991845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0bbe2d9-e65e-44b5-a21a-b9232be7fdf3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:51.999741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0bbe2d9-e65e-44b5-a21a-b9232be7fdf3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:52.010011 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0bbe2d9-e65e-44b5-a21a-b9232be7fdf3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:53.154848 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f0bbe2d9-e65e-44b5-a21a-b9232be7fdf3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:53.187460 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f0bbe2d9-e65e-44b5-a21a-b9232be7fdf3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 1.243958 Aug 01 14:09:53.188797 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 87/169] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:51 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:54.216331 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2d7e5960-48df-40d3-9517-8f0f8cc006eb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:54.217554 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2d7e5960-48df-40d3-9517-8f0f8cc006eb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:54.233073 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2d7e5960-48df-40d3-9517-8f0f8cc006eb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:54.233998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2d7e5960-48df-40d3-9517-8f0f8cc006eb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:54.235606 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2d7e5960-48df-40d3-9517-8f0f8cc006eb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:54.236529 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2d7e5960-48df-40d3-9517-8f0f8cc006eb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:54.619652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2d7e5960-48df-40d3-9517-8f0f8cc006eb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:54.635628 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2d7e5960-48df-40d3-9517-8f0f8cc006eb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 0.428356 Aug 01 14:09:54.636528 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 83/170] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:54 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:55.678819 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d0c95a9f-e375-46fe-a649-aeabbb6177ba tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:55.680377 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d0c95a9f-e375-46fe-a649-aeabbb6177ba tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:55.695387 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d0c95a9f-e375-46fe-a649-aeabbb6177ba tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.702219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d0c95a9f-e375-46fe-a649-aeabbb6177ba tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:55.712952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d0c95a9f-e375-46fe-a649-aeabbb6177ba tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.714117 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d0c95a9f-e375-46fe-a649-aeabbb6177ba tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:56.830167 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d0c95a9f-e375-46fe-a649-aeabbb6177ba tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:56.841924 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d0c95a9f-e375-46fe-a649-aeabbb6177ba tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 1.175498 Aug 01 14:09:56.842688 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 88/171] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:55 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:57.885495 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2305906f-b4b5-4991-ac65-0604c633a69e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:57.894244 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2305906f-b4b5-4991-ac65-0604c633a69e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:57.955859 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2305906f-b4b5-4991-ac65-0604c633a69e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.956677 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2305906f-b4b5-4991-ac65-0604c633a69e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:57.974648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2305906f-b4b5-4991-ac65-0604c633a69e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.975406 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2305906f-b4b5-4991-ac65-0604c633a69e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:59.345524 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2305906f-b4b5-4991-ac65-0604c633a69e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:59.372993 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2305906f-b4b5-4991-ac65-0604c633a69e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 1.495220 Aug 01 14:09:59.383608 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 84/172] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:57 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:00.442843 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e6d969fb-f59a-4dff-b25c-2b6148f9dd49 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:00.455111 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e6d969fb-f59a-4dff-b25c-2b6148f9dd49 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:00.487622 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=30 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:00.520584 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6d969fb-f59a-4dff-b25c-2b6148f9dd49 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:00.546961 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6d969fb-f59a-4dff-b25c-2b6148f9dd49 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:00.555245 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6d969fb-f59a-4dff-b25c-2b6148f9dd49 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:00.555983 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6d969fb-f59a-4dff-b25c-2b6148f9dd49 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:01.696123 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e6d969fb-f59a-4dff-b25c-2b6148f9dd49 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:01.707363 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e6d969fb-f59a-4dff-b25c-2b6148f9dd49 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1521 microversion: 2.1 time: 1.291710 Aug 01 14:10:01.723383 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 89/173] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:00 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1521 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:02.792488 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-da30d84d-1af5-4c04-bf08-1e5486b66cdb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:02.794598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-da30d84d-1af5-4c04-bf08-1e5486b66cdb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:02.834684 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:02.841715 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-da30d84d-1af5-4c04-bf08-1e5486b66cdb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:02.860628 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-da30d84d-1af5-4c04-bf08-1e5486b66cdb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:02.865944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-da30d84d-1af5-4c04-bf08-1e5486b66cdb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:02.871346 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-da30d84d-1af5-4c04-bf08-1e5486b66cdb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:04.141389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-da30d84d-1af5-4c04-bf08-1e5486b66cdb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:04.171719 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-da30d84d-1af5-4c04-bf08-1e5486b66cdb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1501 microversion: 2.1 time: 1.400803 Aug 01 14:10:04.180242 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 85/174] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:02 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1501 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:04.235077 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-297e8431-d0bf-4d04-9538-556f767d6376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:04.240373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-297e8431-d0bf-4d04-9538-556f767d6376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:04.290263 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-297e8431-d0bf-4d04-9538-556f767d6376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:04.299367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-297e8431-d0bf-4d04-9538-556f767d6376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:04.304562 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-297e8431-d0bf-4d04-9538-556f767d6376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:04.308567 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-297e8431-d0bf-4d04-9538-556f767d6376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:05.069474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-297e8431-d0bf-4d04-9538-556f767d6376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:05.081769 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-297e8431-d0bf-4d04-9538-556f767d6376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1515 microversion: 2.1 time: 0.857847 Aug 01 14:10:05.084194 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 90/175] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:04 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1515 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:07.789170 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4f70daae-1e7d-4307-9551-aa5ac566ff12 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:07.806966 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4f70daae-1e7d-4307-9551-aa5ac566ff12 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:07.844027 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f70daae-1e7d-4307-9551-aa5ac566ff12 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:07.845427 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f70daae-1e7d-4307-9551-aa5ac566ff12 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:07.847388 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f70daae-1e7d-4307-9551-aa5ac566ff12 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:07.848586 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f70daae-1e7d-4307-9551-aa5ac566ff12 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:07.893887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=68 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:07.902948 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-4f70daae-1e7d-4307-9551-aa5ac566ff12 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lazy-loading 'flavor' on Instance uuid 36838f66-2529-4a98-88cd-4a0450c2aba5 {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:10:08.284493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4f70daae-1e7d-4307-9551-aa5ac566ff12 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5/action" status: 200 len: 32 microversion: 2.1 time: 0.491460 Aug 01 14:10:08.289674 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 86/176] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:10:07 2022] POST /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5/action => generated 32 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:10:08.306450 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-05640382-7746-41a4-a2a0-170f98f468c4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:08.307653 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-05640382-7746-41a4-a2a0-170f98f468c4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:08.380026 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05640382-7746-41a4-a2a0-170f98f468c4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:08.380854 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05640382-7746-41a4-a2a0-170f98f468c4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:08.386223 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05640382-7746-41a4-a2a0-170f98f468c4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:08.387389 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05640382-7746-41a4-a2a0-170f98f468c4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:09.416855 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-05640382-7746-41a4-a2a0-170f98f468c4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:09.431169 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-05640382-7746-41a4-a2a0-170f98f468c4 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 1.132900 Aug 01 14:10:09.446169 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 91/177] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:08 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:10.103182 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bbaa7f66-6d97-4c0d-ade0-8d247785c609 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:10.104177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bbaa7f66-6d97-4c0d-ade0-8d247785c609 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:10.136957 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbaa7f66-6d97-4c0d-ade0-8d247785c609 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:10.137440 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbaa7f66-6d97-4c0d-ade0-8d247785c609 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:10.138268 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbaa7f66-6d97-4c0d-ade0-8d247785c609 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:10.138702 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbaa7f66-6d97-4c0d-ade0-8d247785c609 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:10.294243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bbaa7f66-6d97-4c0d-ade0-8d247785c609 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/ips" status: 200 len: 145 microversion: 2.1 time: 0.200679 Aug 01 14:10:10.303926 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 87/178] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:10:10 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/ips => generated 145 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:10.470489 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f04b0890-bece-43c4-b63c-91a1d794fc33 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:10.474282 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f04b0890-bece-43c4-b63c-91a1d794fc33 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:10.519103 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f04b0890-bece-43c4-b63c-91a1d794fc33 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:10.520558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f04b0890-bece-43c4-b63c-91a1d794fc33 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:10.530754 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f04b0890-bece-43c4-b63c-91a1d794fc33 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:10.534510 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f04b0890-bece-43c4-b63c-91a1d794fc33 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:11.275144 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f04b0890-bece-43c4-b63c-91a1d794fc33 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:11.312326 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f04b0890-bece-43c4-b63c-91a1d794fc33 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 0.846992 Aug 01 14:10:11.324004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 92/179] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:10 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:12.374758 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-04d739f8-0e55-433f-8437-7c0d95f58863 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:12.379697 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-04d739f8-0e55-433f-8437-7c0d95f58863 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:12.434310 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04d739f8-0e55-433f-8437-7c0d95f58863 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:12.435914 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04d739f8-0e55-433f-8437-7c0d95f58863 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:12.439043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04d739f8-0e55-433f-8437-7c0d95f58863 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:12.440641 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04d739f8-0e55-433f-8437-7c0d95f58863 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:13.639118 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-62b50a69-8f9d-480d-bd42-19b1ff5e8bf4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'create', calling method: .version_select at 0x7fc579bb13a0>, body: {"keypair": {"name": "tempest-keypair-2102070334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFN7Qfd3xuABOpbjbE5GD5EBKu+6hEkcbjfqMBt2oF2ia6xtHAvrVpXLVK5QdoXdDoGe1qMRhK1gfccYQ69JnrV8sZLomFpk6TfaxH7/KfRH4qUh1NKC2oLq+RUesP0tw=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:13.714089 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-62b50a69-8f9d-480d-bd42-19b1ff5e8bf4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Getting quotas for project c86a28aa09db413593b6047d4cbd0559. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:13.745710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-62b50a69-8f9d-480d-bd42-19b1ff5e8bf4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Getting quotas for user 403896b926a1445b9895dc2d8d21854f and project c86a28aa09db413593b6047d4cbd0559. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:13.869642 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-62b50a69-8f9d-480d-bd42-19b1ff5e8bf4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.620610 Aug 01 14:10:13.894687 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 93/180] 10.222.0.45 () {62 vars in 1200 bytes} [Mon Aug 1 14:10:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 636 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:14.628095 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-04d739f8-0e55-433f-8437-7c0d95f58863 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:14.674682 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-04d739f8-0e55-433f-8437-7c0d95f58863 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 2.307355 Aug 01 14:10:14.702967 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 88/181] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:12 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:14.792724 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f0554c38-6ecc-4a31-aa7c-1036eac7101d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee8ef593-d0b1-4e89-a909-141739bfa0c8"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:14.838687 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f0554c38-6ecc-4a31-aa7c-1036eac7101d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:14.894687 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0554c38-6ecc-4a31-aa7c-1036eac7101d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:14.896247 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0554c38-6ecc-4a31-aa7c-1036eac7101d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:14.898829 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0554c38-6ecc-4a31-aa7c-1036eac7101d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:14.909388 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0554c38-6ecc-4a31-aa7c-1036eac7101d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:14.942750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=49 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:15.729949 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c4383a30-3004-4f0b-9291-0ddfea0b0cb8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:15.731236 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c4383a30-3004-4f0b-9291-0ddfea0b0cb8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:15.756877 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c4383a30-3004-4f0b-9291-0ddfea0b0cb8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:15.757315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c4383a30-3004-4f0b-9291-0ddfea0b0cb8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:15.759300 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c4383a30-3004-4f0b-9291-0ddfea0b0cb8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:15.759734 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c4383a30-3004-4f0b-9291-0ddfea0b0cb8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:16.308312 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f0554c38-6ecc-4a31-aa7c-1036eac7101d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.522370 Aug 01 14:10:16.311535 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 94/182] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:10:14 2022] POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/os-volume_attachments => generated 194 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:17.215556 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c4383a30-3004-4f0b-9291-0ddfea0b0cb8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:17.248483 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c4383a30-3004-4f0b-9291-0ddfea0b0cb8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 1.525416 Aug 01 14:10:17.250124 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 89/183] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:15 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:18.294875 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1e253b78-f298-4971-a42f-00b3329abda6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:18.296157 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1e253b78-f298-4971-a42f-00b3329abda6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:18.331713 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1e253b78-f298-4971-a42f-00b3329abda6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:18.332549 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1e253b78-f298-4971-a42f-00b3329abda6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:18.333992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1e253b78-f298-4971-a42f-00b3329abda6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:18.335013 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1e253b78-f298-4971-a42f-00b3329abda6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:20.033429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1e253b78-f298-4971-a42f-00b3329abda6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:20.061667 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1e253b78-f298-4971-a42f-00b3329abda6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 1.785188 Aug 01 14:10:20.062731 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 95/184] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:18 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:21.088432 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-323e2e8b-9e1c-46b6-b36b-3f960e5b8736 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:21.090412 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-323e2e8b-9e1c-46b6-b36b-3f960e5b8736 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:21.113588 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-323e2e8b-9e1c-46b6-b36b-3f960e5b8736 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:21.118142 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-323e2e8b-9e1c-46b6-b36b-3f960e5b8736 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:21.122709 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-323e2e8b-9e1c-46b6-b36b-3f960e5b8736 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:21.126989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-323e2e8b-9e1c-46b6-b36b-3f960e5b8736 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:21.812245 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-323e2e8b-9e1c-46b6-b36b-3f960e5b8736 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:21.812558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1861540931", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "294e8be6-62c8-4d19-be24-df34926b9c6c"}], "security_groups": [{"name": "tempest-securitygroup--1876790496"}], "key_name": "tempest-keypair-2102070334", "user_data": "}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:21.830937 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-323e2e8b-9e1c-46b6-b36b-3f960e5b8736 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 0.746429 Aug 01 14:10:21.838544 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 90/185] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:21 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:22.740895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] validate_networks() for [('294e8be6-62c8-4d19-be24-df34926b9c6c', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:10:22.882584 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-52bc3a79-2195-4b32-b059-216f9564e160 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:22.886919 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-52bc3a79-2195-4b32-b059-216f9564e160 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:22.925023 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-52bc3a79-2195-4b32-b059-216f9564e160 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:22.960829 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-52bc3a79-2195-4b32-b059-216f9564e160 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:22.969415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-52bc3a79-2195-4b32-b059-216f9564e160 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:22.973623 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-52bc3a79-2195-4b32-b059-216f9564e160 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:23.794556 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:24.906301 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-52bc3a79-2195-4b32-b059-216f9564e160 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:24.981348 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-52bc3a79-2195-4b32-b059-216f9564e160 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 2.107775 Aug 01 14:10:25.022735 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 91/186] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:22 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:25.110101 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:10:25.110825 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:10:25.111346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:10:25.111971 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:10:25.112496 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:10:25.160827 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:25.168956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:25.174014 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:25.182886 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:25.394849 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Getting quotas for project c86a28aa09db413593b6047d4cbd0559. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:25.428867 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Getting quotas for user 403896b926a1445b9895dc2d8d21854f and project c86a28aa09db413593b6047d4cbd0559. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:25.577249 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-77eb451b-3333-4852-b369-46ddaf74fc63 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:25.583784 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:10:25.590102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:10:25.609270 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-77eb451b-3333-4852-b369-46ddaf74fc63 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:25.619069 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-77eb451b-3333-4852-b369-46ddaf74fc63 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:25.930913 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fe597edd-cbd8-46fa-a960-3dcf64a9918a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.121711 Aug 01 14:10:25.940456 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 96/187] 10.222.0.45 () {62 vars in 1188 bytes} [Mon Aug 1 14:10:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 4142 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 14:10:25.989153 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4021ee59-001f-4975-9bf3-ccd39311b380 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:25.999859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4021ee59-001f-4975-9bf3-ccd39311b380 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:26.179614 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-77eb451b-3333-4852-b369-46ddaf74fc63 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Going to try to stop instance {{(pid=118110) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 14:10:26.404195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-77eb451b-3333-4852-b369-46ddaf74fc63 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/action" status: 202 len: 0 microversion: 2.1 time: 0.834393 Aug 01 14:10:26.419604 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 92/188] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:10:25 2022] POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/action => generated 0 bytes in 851 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:10:26.431795 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bbc84e05-6ab3-445f-8d01-e58eebc69840 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:26.439020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bbc84e05-6ab3-445f-8d01-e58eebc69840 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:26.480384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbc84e05-6ab3-445f-8d01-e58eebc69840 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.484073 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbc84e05-6ab3-445f-8d01-e58eebc69840 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:26.487236 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbc84e05-6ab3-445f-8d01-e58eebc69840 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.492022 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbc84e05-6ab3-445f-8d01-e58eebc69840 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:27.912827 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4021ee59-001f-4975-9bf3-ccd39311b380 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:27.944043 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4021ee59-001f-4975-9bf3-ccd39311b380 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:27.965844 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4021ee59-001f-4975-9bf3-ccd39311b380 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:27.967926 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4021ee59-001f-4975-9bf3-ccd39311b380 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1282 microversion: 2.20 time: 2.021937 Aug 01 14:10:27.976930 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 97/189] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:25 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1282 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:27.988680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-89566d45-ab0d-4f74-adaa-49f716809331 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:27.990243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-89566d45-ab0d-4f74-adaa-49f716809331 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:27.999029 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89566d45-ab0d-4f74-adaa-49f716809331 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:27.999780 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89566d45-ab0d-4f74-adaa-49f716809331 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:28.000911 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89566d45-ab0d-4f74-adaa-49f716809331 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:28.004910 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89566d45-ab0d-4f74-adaa-49f716809331 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:28.268553 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bbc84e05-6ab3-445f-8d01-e58eebc69840 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:28.306173 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bbc84e05-6ab3-445f-8d01-e58eebc69840 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 1.883049 Aug 01 14:10:28.309778 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 93/190] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:26 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:29.019671 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:29.021734 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:29.041407 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.045722 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:29.047716 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.051080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:29.101371 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-89566d45-ab0d-4f74-adaa-49f716809331 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:29.144482 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-89566d45-ab0d-4f74-adaa-49f716809331 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1723 microversion: 2.1 time: 1.165372 Aug 01 14:10:29.147076 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 98/191] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:27 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1723 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:29.350660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0926bc67-f836-4395-9afe-94dffac36f76 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:29.352312 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:29.356033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0926bc67-f836-4395-9afe-94dffac36f76 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:29.387267 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:29.394366 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:29.396403 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0926bc67-f836-4395-9afe-94dffac36f76 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.403830 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3c187688-8963-4236-a47d-7d8dbcb133b0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1278 microversion: 2.20 time: 0.388229 Aug 01 14:10:29.406361 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 94/192] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:29 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1278 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:10:29.417217 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0926bc67-f836-4395-9afe-94dffac36f76 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:29.427382 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0926bc67-f836-4395-9afe-94dffac36f76 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.435463 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0926bc67-f836-4395-9afe-94dffac36f76 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.113396 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0926bc67-f836-4395-9afe-94dffac36f76 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:30.129193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0926bc67-f836-4395-9afe-94dffac36f76 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 0.787210 Aug 01 14:10:30.129812 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 99/193] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:29 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:30.186712 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-04049f8a-edbf-4c73-9f80-0ceb36405104 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:30.194080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-04049f8a-edbf-4c73-9f80-0ceb36405104 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:30.243217 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04049f8a-edbf-4c73-9f80-0ceb36405104 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:30.269869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04049f8a-edbf-4c73-9f80-0ceb36405104 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.281414 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04049f8a-edbf-4c73-9f80-0ceb36405104 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:30.282556 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-04049f8a-edbf-4c73-9f80-0ceb36405104 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.442922 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:30.443538 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:30.467693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:30.468414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.469672 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:30.470359 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.812731 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:30.831271 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:30.832921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:30.834105 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-22c6baed-605e-45cd-a173-90b3723c48e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1334 microversion: 2.20 time: 0.396460 Aug 01 14:10:30.834696 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 100/194] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:30 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1334 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:31.153616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e434936d-3108-45d4-b137-8e859bc93240 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:31.154978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e434936d-3108-45d4-b137-8e859bc93240 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:31.158231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:31.170934 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e434936d-3108-45d4-b137-8e859bc93240 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:31.171679 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e434936d-3108-45d4-b137-8e859bc93240 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:31.173228 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e434936d-3108-45d4-b137-8e859bc93240 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:31.179767 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e434936d-3108-45d4-b137-8e859bc93240 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.009370 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-04049f8a-edbf-4c73-9f80-0ceb36405104 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:32.035727 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-04049f8a-edbf-4c73-9f80-0ceb36405104 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1723 microversion: 2.1 time: 1.866258 Aug 01 14:10:32.045108 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 95/195] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:30 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1723 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:32.059991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:32.085077 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:32.115509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.122778 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.129565 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.130827 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.462432 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:32.491959 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:32.495240 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:32.495584 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e434936d-3108-45d4-b137-8e859bc93240 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:32.501720 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ad539aea-eab6-4b67-9a92-1f5425d527f4 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1340 microversion: 2.20 time: 0.443444 Aug 01 14:10:32.504023 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 96/196] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:32 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1340 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:32.517731 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e434936d-3108-45d4-b137-8e859bc93240 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1501 microversion: 2.1 time: 1.368622 Aug 01 14:10:32.537089 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 101/197] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:31 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1501 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:32.544674 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ba660d6-1070-4a6e-9956-d893f22a84a3"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:32.553869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:32.598681 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.602367 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.604243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.610404 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.678927 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] HTTP exception thrown: Cannot 'attach_volume' instance 36838f66-2529-4a98-88cd-4a0450c2aba5 while it is in vm_state rescued Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Request method failure captured: Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: POST /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5/os-volume_attachments HTTP/1.1 Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 74 Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi595nBvngFLvXmcxyqRbq0vAZso55lRqZPdXo9mG7MzO7BEgpjGUJXmDJ-Wrlr5gSX2E3O49ldx2NkMHkhpNVEedoqx6r8Ucd5xA2QvZhi4cW0ovwwW2Ary3iU0xyJcDZxg2MxyAC0etakIhVNhyVB6hrmON2qyAVhF4w9-kPyJ8xt6U Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:10:32.692890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e85f3e6c18ae4466a1dc3e6464aa18e6", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}] Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: a3e93dfa85244133b1641a431994b47f Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {"volumeAttachment": {"volumeId": "2ba660d6-1070-4a6e-9956-d893f22a84a3"}} Aug 01 14:10:32.694452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Cannot 'attach_volume' instance 36838f66-2529-4a98-88cd-4a0450c2aba5 while it is in vm_state rescued Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'server_id': '36838f66-2529-4a98-88cd-4a0450c2aba5', 'body': {'volumeAttachment': {'volumeId': '2ba660d6-1070-4a6e-9956-d893f22a84a3'}}} Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 36838f66-2529-4a98-88cd-4a0450c2aba5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:10:32.695272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 36838f66-2529-4a98-88cd-4a0450c2aba5 while it is in vm_state rescued Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:32.705277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:32.706492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:10:32.706492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:10:32.706492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 36838f66-2529-4a98-88cd-4a0450c2aba5 while it is in vm_state rescued Aug 01 14:10:32.706492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:10:32.706492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Returning 409 to user: Cannot 'attach_volume' instance 36838f66-2529-4a98-88cd-4a0450c2aba5 while it is in vm_state rescued {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:10:32.706492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3c0c6e77-3bb9-48ce-a344-83d7b5381b72 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.158205 Aug 01 14:10:32.706492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 97/198] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:10:32 2022] POST /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5/os-volume_attachments => generated 152 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 14:10:32.717046 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6af66c3a-3bf2-4e67-95ab-3a227fc4c62b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:32.718137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6af66c3a-3bf2-4e67-95ab-3a227fc4c62b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:32.737289 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6af66c3a-3bf2-4e67-95ab-3a227fc4c62b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.738358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6af66c3a-3bf2-4e67-95ab-3a227fc4c62b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.739494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6af66c3a-3bf2-4e67-95ab-3a227fc4c62b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.740442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6af66c3a-3bf2-4e67-95ab-3a227fc4c62b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.859659 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6af66c3a-3bf2-4e67-95ab-3a227fc4c62b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5/action" status: 202 len: 0 microversion: 2.1 time: 0.148184 Aug 01 14:10:32.865193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 102/199] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:10:32 2022] POST /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:10:32.876243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8ebef2f8-2ec7-429c-9f8f-f7687db1ac91 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:32.882563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8ebef2f8-2ec7-429c-9f8f-f7687db1ac91 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:32.953435 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=26 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:32.975764 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8ebef2f8-2ec7-429c-9f8f-f7687db1ac91 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.986206 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8ebef2f8-2ec7-429c-9f8f-f7687db1ac91 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.995159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8ebef2f8-2ec7-429c-9f8f-f7687db1ac91 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.004295 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8ebef2f8-2ec7-429c-9f8f-f7687db1ac91 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:33.077557 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6b8098a5-38c1-420f-bab0-29df23c40baf tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:33.078567 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6b8098a5-38c1-420f-bab0-29df23c40baf tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:33.092452 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6b8098a5-38c1-420f-bab0-29df23c40baf tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.097005 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6b8098a5-38c1-420f-bab0-29df23c40baf tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:33.099331 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6b8098a5-38c1-420f-bab0-29df23c40baf tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.101291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6b8098a5-38c1-420f-bab0-29df23c40baf tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.328903 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6b8098a5-38c1-420f-bab0-29df23c40baf tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:34.414143 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8ebef2f8-2ec7-429c-9f8f-f7687db1ac91 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:34.416380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6b8098a5-38c1-420f-bab0-29df23c40baf tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1723 microversion: 2.1 time: 1.343854 Aug 01 14:10:34.423815 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 103/200] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:33 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1723 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:34.492686 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:34.496151 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8ebef2f8-2ec7-429c-9f8f-f7687db1ac91 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1509 microversion: 2.1 time: 1.626601 Aug 01 14:10:34.496475 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:34.510804 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.513929 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 98/201] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:32 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1509 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:34.525449 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.527111 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.528023 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.960306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:35.038238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:35.052852 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:35.057378 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-46f28a45-9c16-4ed6-9f4d-fb1fc2eafeda tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1340 microversion: 2.20 time: 0.627189 Aug 01 14:10:35.073211 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 104/202] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:34 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1340 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:35.464210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-32fad057-e5e4-47c7-a369-0d5177210c5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:35.465599 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-32fad057-e5e4-47c7-a369-0d5177210c5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:35.483072 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32fad057-e5e4-47c7-a369-0d5177210c5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:35.485104 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32fad057-e5e4-47c7-a369-0d5177210c5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:35.486481 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32fad057-e5e4-47c7-a369-0d5177210c5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:35.490347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32fad057-e5e4-47c7-a369-0d5177210c5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:35.565676 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ab6c2e40-5349-49ae-83aa-1d0d06f87af8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:35.570573 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ab6c2e40-5349-49ae-83aa-1d0d06f87af8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:35.583331 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:35.613845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab6c2e40-5349-49ae-83aa-1d0d06f87af8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:35.616650 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab6c2e40-5349-49ae-83aa-1d0d06f87af8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:35.618671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab6c2e40-5349-49ae-83aa-1d0d06f87af8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:35.623459 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab6c2e40-5349-49ae-83aa-1d0d06f87af8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.542921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ab6c2e40-5349-49ae-83aa-1d0d06f87af8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:36.596149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ab6c2e40-5349-49ae-83aa-1d0d06f87af8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1509 microversion: 2.1 time: 1.037424 Aug 01 14:10:36.616311 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 105/203] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:35 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1509 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:36.672692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:36.674242 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:36.695256 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.696263 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.697299 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.697894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:37.091860 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-32fad057-e5e4-47c7-a369-0d5177210c5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:37.108770 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-32fad057-e5e4-47c7-a369-0d5177210c5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1723 microversion: 2.1 time: 1.648730 Aug 01 14:10:37.120827 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 99/204] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:35 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1723 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:37.255601 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:37.277558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:37.279897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:37.282082 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6d34393f-3ca9-4cce-9e63-ab067c1981b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1340 microversion: 2.20 time: 0.668170 Aug 01 14:10:37.291493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 106/205] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:36 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1340 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:37.644035 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b19e992e-6080-4a8c-ada9-c2adbaedaca6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:37.645071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b19e992e-6080-4a8c-ada9-c2adbaedaca6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:37.668508 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b19e992e-6080-4a8c-ada9-c2adbaedaca6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:37.674642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b19e992e-6080-4a8c-ada9-c2adbaedaca6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:37.676642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b19e992e-6080-4a8c-ada9-c2adbaedaca6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:37.678151 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b19e992e-6080-4a8c-ada9-c2adbaedaca6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:37.736178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:38.161617 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-64331533-db1e-4916-9601-fb123766f6b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:38.165862 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-64331533-db1e-4916-9601-fb123766f6b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:38.182587 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=8 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:38.202635 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64331533-db1e-4916-9601-fb123766f6b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:38.204339 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64331533-db1e-4916-9601-fb123766f6b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:38.207543 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64331533-db1e-4916-9601-fb123766f6b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:38.219744 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64331533-db1e-4916-9601-fb123766f6b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:38.352628 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b19e992e-6080-4a8c-ada9-c2adbaedaca6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:38.393524 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b19e992e-6080-4a8c-ada9-c2adbaedaca6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1509 microversion: 2.1 time: 0.756530 Aug 01 14:10:38.432656 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 100/206] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:37 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1509 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:38.463418 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:38.465528 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:38.503809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:38.506946 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:38.508147 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:38.512253 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:39.122646 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-64331533-db1e-4916-9601-fb123766f6b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:39.156413 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-64331533-db1e-4916-9601-fb123766f6b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1723 microversion: 2.1 time: 1.001240 Aug 01 14:10:39.208407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 107/207] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:38 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1723 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:39.250748 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:39.278330 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:39.280955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:39.286614 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c18df490-eaad-4a19-a6c0-80228ca706a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1408 microversion: 2.20 time: 0.852105 Aug 01 14:10:39.301257 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 101/208] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:38 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1408 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:39.426434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-860750033", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "networks": [{"uuid": "c4cb3d68-e398-4275-a8a5-8ceae3ba3e0b"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:39.455077 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5ee4a8a5-1a5a-40e0-b76a-2df842cc92fe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:39.455718 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5ee4a8a5-1a5a-40e0-b76a-2df842cc92fe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:39.480578 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5ee4a8a5-1a5a-40e0-b76a-2df842cc92fe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:39.481619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5ee4a8a5-1a5a-40e0-b76a-2df842cc92fe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:39.485219 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5ee4a8a5-1a5a-40e0-b76a-2df842cc92fe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:39.486134 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5ee4a8a5-1a5a-40e0-b76a-2df842cc92fe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:39.626719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] validate_networks() for [('c4cb3d68-e398-4275-a8a5-8ceae3ba3e0b', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:10:40.886624 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5ee4a8a5-1a5a-40e0-b76a-2df842cc92fe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:40.901076 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5ee4a8a5-1a5a-40e0-b76a-2df842cc92fe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1509 microversion: 2.1 time: 1.453286 Aug 01 14:10:40.919395 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 102/209] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:39 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1509 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:40.942012 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ea4e15b4-d869-4b1c-bfd5-021d4cab9904 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:40.942839 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ea4e15b4-d869-4b1c-bfd5-021d4cab9904 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:40.956988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ea4e15b4-d869-4b1c-bfd5-021d4cab9904 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:40.958464 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ea4e15b4-d869-4b1c-bfd5-021d4cab9904 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:40.960038 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ea4e15b4-d869-4b1c-bfd5-021d4cab9904 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:40.963342 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ea4e15b4-d869-4b1c-bfd5-021d4cab9904 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.225035 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:10:42.226108 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:10:42.235238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:10:42.235936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:10:42.236730 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:10:42.297476 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.298273 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.299811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.306789 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.374223 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ea4e15b4-d869-4b1c-bfd5-021d4cab9904 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:42.386909 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ea4e15b4-d869-4b1c-bfd5-021d4cab9904 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1723 microversion: 2.1 time: 1.465756 Aug 01 14:10:42.408754 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Getting quotas for project 803bbc59642547fb932be578cb70ac3f. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:42.410283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 103/210] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:40 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1723 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:42.442683 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:42.445458 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:42.471309 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Getting quotas for user 824b6455aab74659a9fb1e5e8f7c2965 and project 803bbc59642547fb932be578cb70ac3f. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:42.487686 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.490473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.493539 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.496659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.584012 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:10:42.601275 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:10:42.822472 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9557b2fe-9fe9-4a46-b028-131d4a396dcf tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.402073 Aug 01 14:10:42.839941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 108/211] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:10:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:10:42.867826 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-af3d62ac-f81a-46a7-91c7-e7a5e42cecf8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:42.871323 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-af3d62ac-f81a-46a7-91c7-e7a5e42cecf8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:42.910216 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af3d62ac-f81a-46a7-91c7-e7a5e42cecf8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.916833 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af3d62ac-f81a-46a7-91c7-e7a5e42cecf8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.923287 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af3d62ac-f81a-46a7-91c7-e7a5e42cecf8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.931373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af3d62ac-f81a-46a7-91c7-e7a5e42cecf8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:44.372703 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-af3d62ac-f81a-46a7-91c7-e7a5e42cecf8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:44.389754 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-af3d62ac-f81a-46a7-91c7-e7a5e42cecf8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1515 microversion: 2.1 time: 1.547622 Aug 01 14:10:44.390874 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 109/212] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:42 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1515 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:44.459299 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-52276493-7f04-4afd-b6fb-f33bed93c032 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:44.465821 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-52276493-7f04-4afd-b6fb-f33bed93c032 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:44.492041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:44.528064 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:44.553012 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:44.557135 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-12bac905-c953-40d3-956e-1c46e449f0ad tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1408 microversion: 2.20 time: 2.140235 Aug 01 14:10:44.570473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 104/213] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:42 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1408 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:44.597268 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-882d3727-7c7a-48b6-a33a-ea5dd231dd69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:44.597956 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-882d3727-7c7a-48b6-a33a-ea5dd231dd69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:44.620159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-882d3727-7c7a-48b6-a33a-ea5dd231dd69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:44.620640 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-882d3727-7c7a-48b6-a33a-ea5dd231dd69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:44.631616 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-882d3727-7c7a-48b6-a33a-ea5dd231dd69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:44.634193 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-882d3727-7c7a-48b6-a33a-ea5dd231dd69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.021405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-52276493-7f04-4afd-b6fb-f33bed93c032 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:45.045296 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-52276493-7f04-4afd-b6fb-f33bed93c032 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1213 microversion: 2.1 time: 0.603401 Aug 01 14:10:45.048165 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 110/214] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:44 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1213 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:45.073320 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-5da217a7-8428-402f-854c-256ce8b99585 req-9668a3cf-f131-42aa-817a-f1854bbfdcff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446cfa38-0982-47b2-8e3f-a44a35257447", "tag": "3c265e4a-7314-4d99-a248-2eb055ab90c0"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:45.105125 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-5da217a7-8428-402f-854c-256ce8b99585 req-9668a3cf-f131-42aa-817a-f1854bbfdcff service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.108806 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-5da217a7-8428-402f-854c-256ce8b99585 req-9668a3cf-f131-42aa-817a-f1854bbfdcff service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.145455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:45.169584 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-5da217a7-8428-402f-854c-256ce8b99585 req-9668a3cf-f131-42aa-817a-f1854bbfdcff service nova] Creating event network-changed:3c265e4a-7314-4d99-a248-2eb055ab90c0 for instance 446cfa38-0982-47b2-8e3f-a44a35257447 on hv-cinder-84517 Aug 01 14:10:45.197128 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-5da217a7-8428-402f-854c-256ce8b99585 req-9668a3cf-f131-42aa-817a-f1854bbfdcff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133685 Aug 01 14:10:45.202210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 111/215] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:45.605112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:45.609448 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:45.613542 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-882d3727-7c7a-48b6-a33a-ea5dd231dd69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:45.627506 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-882d3727-7c7a-48b6-a33a-ea5dd231dd69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1723 microversion: 2.1 time: 1.054382 Aug 01 14:10:45.628179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 105/216] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:44 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1723 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:45.644123 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.645250 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.648821 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.650543 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.074451 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-399e7949-e0ae-490f-b0e9-8a002284e162 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:46.075448 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-399e7949-e0ae-490f-b0e9-8a002284e162 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:46.103446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-399e7949-e0ae-490f-b0e9-8a002284e162 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:46.107163 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-399e7949-e0ae-490f-b0e9-8a002284e162 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.115290 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-399e7949-e0ae-490f-b0e9-8a002284e162 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:46.121723 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-399e7949-e0ae-490f-b0e9-8a002284e162 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.710694 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:46.734915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:46.741146 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:46.744636 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a86b29ec-f423-4b49-a2cf-d32d93b5fd6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1408 microversion: 2.20 time: 1.150604 Aug 01 14:10:46.747884 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 112/217] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:45 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1408 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:46.758308 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-baec30d0-72e7-49bc-92ba-ebb39ae32638 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:46.760657 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-baec30d0-72e7-49bc-92ba-ebb39ae32638 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:46.776876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-baec30d0-72e7-49bc-92ba-ebb39ae32638 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:46.779885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-baec30d0-72e7-49bc-92ba-ebb39ae32638 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.786558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-baec30d0-72e7-49bc-92ba-ebb39ae32638 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:46.788155 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-baec30d0-72e7-49bc-92ba-ebb39ae32638 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.837679 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-399e7949-e0ae-490f-b0e9-8a002284e162 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:46.865765 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-399e7949-e0ae-490f-b0e9-8a002284e162 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1265 microversion: 2.1 time: 0.796575 Aug 01 14:10:46.873126 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 106/218] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:46 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1265 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:46.886079 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f6083e08-9e02-41a6-aa21-1404038a9343 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'create', calling method: .version_select at 0x7fc57a24b9d0>, body: {"keypair": {"name": "tempest-keypair-1620377446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhNQgjLwr9ismtSnWm/93Eeu0EWpR151Ksi/luY8iiLVIp1F2/9EBtaMuD/Vv+p6jdVUKf69n6OTsWTbuuIOe7DDfuv056wQBvHs2EQ34D6mZZOA7N70N/h4whSLa0t9A=="}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:46.966635 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-f6083e08-9e02-41a6-aa21-1404038a9343 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Getting quotas for project e85f3e6c18ae4466a1dc3e6464aa18e6. Resources: {'key_pairs'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:46.985985 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-f6083e08-9e02-41a6-aa21-1404038a9343 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Getting quotas for user a3e93dfa85244133b1641a431994b47f and project e85f3e6c18ae4466a1dc3e6464aa18e6. Resources: {'key_pairs'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:47.122995 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f6083e08-9e02-41a6-aa21-1404038a9343 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.248236 Aug 01 14:10:47.126252 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 107/219] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:10:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:47.356029 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-baec30d0-72e7-49bc-92ba-ebb39ae32638 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:47.386635 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-baec30d0-72e7-49bc-92ba-ebb39ae32638 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1700 microversion: 2.1 time: 0.636966 Aug 01 14:10:47.401210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 113/220] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:46 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1700 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:47.465606 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0ef9e4ab-dee5-4c46-835a-4ef1cf85e7b8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:47.495170 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0ef9e4ab-dee5-4c46-835a-4ef1cf85e7b8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:47.496965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0ef9e4ab-dee5-4c46-835a-4ef1cf85e7b8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:47.654819 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0ef9e4ab-dee5-4c46-835a-4ef1cf85e7b8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Going to try to start instance {{(pid=118110) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 14:10:47.806414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:47.807217 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:47.826136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:47.826764 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:47.827909 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:47.832103 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:47.981052 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0ef9e4ab-dee5-4c46-835a-4ef1cf85e7b8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/action" status: 202 len: 0 microversion: 2.1 time: 0.518272 Aug 01 14:10:47.982138 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 108/221] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:10:47 2022] POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:10:47.998036 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6d33f502-ec20-45f5-a3a7-65630ce41036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:48.012467 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6d33f502-ec20-45f5-a3a7-65630ce41036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:48.034095 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6d33f502-ec20-45f5-a3a7-65630ce41036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.034880 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6d33f502-ec20-45f5-a3a7-65630ce41036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:48.038772 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6d33f502-ec20-45f5-a3a7-65630ce41036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.040609 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6d33f502-ec20-45f5-a3a7-65630ce41036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:48.388161 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6d33f502-ec20-45f5-a3a7-65630ce41036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:48.414910 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6d33f502-ec20-45f5-a3a7-65630ce41036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1271 microversion: 2.1 time: 0.430456 Aug 01 14:10:48.419494 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 109/222] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:47 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1271 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:48.443493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ab0e29c7-1825-4378-8a3a-496398b1a6e1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:48.445541 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ab0e29c7-1825-4378-8a3a-496398b1a6e1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:48.477498 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab0e29c7-1825-4378-8a3a-496398b1a6e1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.478342 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab0e29c7-1825-4378-8a3a-496398b1a6e1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:48.483864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab0e29c7-1825-4378-8a3a-496398b1a6e1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.488725 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab0e29c7-1825-4378-8a3a-496398b1a6e1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.409005 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:49.421338 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:49.431880 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:49.433597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d9d4b64e-b9ed-41db-9c44-8c4298c7fe7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1408 microversion: 2.20 time: 1.639174 Aug 01 14:10:49.471092 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 114/223] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:47 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1408 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:49.477842 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ab0e29c7-1825-4378-8a3a-496398b1a6e1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:49.487807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-89f9b33e-7327-4a6b-a8c8-4bef3fa36b1d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:49.490234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-89f9b33e-7327-4a6b-a8c8-4bef3fa36b1d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:49.506321 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ab0e29c7-1825-4378-8a3a-496398b1a6e1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1709 microversion: 2.1 time: 1.084486 Aug 01 14:10:49.514338 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89f9b33e-7327-4a6b-a8c8-4bef3fa36b1d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:49.518504 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 110/224] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:48 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1709 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:49.519294 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89f9b33e-7327-4a6b-a8c8-4bef3fa36b1d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.520491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89f9b33e-7327-4a6b-a8c8-4bef3fa36b1d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:49.521864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89f9b33e-7327-4a6b-a8c8-4bef3fa36b1d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.956964 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-89f9b33e-7327-4a6b-a8c8-4bef3fa36b1d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:49.986797 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-89f9b33e-7327-4a6b-a8c8-4bef3fa36b1d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1271 microversion: 2.1 time: 0.513999 Aug 01 14:10:49.991455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 115/225] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:49 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1271 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:50.494929 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:50.502239 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:50.540603 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.551194 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:50.570581 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-51c117de-bfc3-4747-817b-f1a077621178 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:50.577779 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.578430 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-51c117de-bfc3-4747-817b-f1a077621178 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:50.598212 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:50.664258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51c117de-bfc3-4747-817b-f1a077621178 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.665675 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51c117de-bfc3-4747-817b-f1a077621178 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:50.670350 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51c117de-bfc3-4747-817b-f1a077621178 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.671140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51c117de-bfc3-4747-817b-f1a077621178 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:52.347029 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:52.568597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-51c117de-bfc3-4747-817b-f1a077621178 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:52.591563 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-51c117de-bfc3-4747-817b-f1a077621178 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1709 microversion: 2.1 time: 2.037961 Aug 01 14:10:52.608877 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 116/226] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:50 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1709 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:52.621091 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9d8187e2-06ab-47a0-b764-44a13328fe0d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:52.623971 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9d8187e2-06ab-47a0-b764-44a13328fe0d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:52.632012 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d8187e2-06ab-47a0-b764-44a13328fe0d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:52.632911 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d8187e2-06ab-47a0-b764-44a13328fe0d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:52.633909 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d8187e2-06ab-47a0-b764-44a13328fe0d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:52.634541 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d8187e2-06ab-47a0-b764-44a13328fe0d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:52.993976 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:53.019946 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:53.027067 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:53.033074 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4b04200e-d77e-4ef5-8db0-aa84b4fcfc93 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1408 microversion: 2.20 time: 2.552922 Aug 01 14:10:53.037530 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 111/227] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:50 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1408 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:53.634175 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-013fef3d-289f-4342-af6f-45ed23db3262 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:53.637753 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-013fef3d-289f-4342-af6f-45ed23db3262 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:53.690838 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-013fef3d-289f-4342-af6f-45ed23db3262 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:53.692044 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-013fef3d-289f-4342-af6f-45ed23db3262 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:53.693944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-013fef3d-289f-4342-af6f-45ed23db3262 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:53.694661 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-013fef3d-289f-4342-af6f-45ed23db3262 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:54.381166 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9d8187e2-06ab-47a0-b764-44a13328fe0d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:54.390987 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9d8187e2-06ab-47a0-b764-44a13328fe0d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 1.780793 Aug 01 14:10:54.403933 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 117/228] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:52 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:54.432199 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:54.438582 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:54.475271 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:54.482906 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:54.489332 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:54.490578 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:54.597903 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-013fef3d-289f-4342-af6f-45ed23db3262 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:54.611826 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-013fef3d-289f-4342-af6f-45ed23db3262 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1709 microversion: 2.1 time: 0.989120 Aug 01 14:10:54.613567 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 112/229] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:53 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1709 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:55.027319 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=8 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:55.126982 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-b6d3fb66-f34d-42ca-895d-c13f2b4c902c req-2c55b334-8c5d-40e3-83e6-9bc985a2d314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446cfa38-0982-47b2-8e3f-a44a35257447", "name": "network-vif-plugged", "status": "completed", "tag": "3c265e4a-7314-4d99-a248-2eb055ab90c0"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:55.151703 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-b6d3fb66-f34d-42ca-895d-c13f2b4c902c req-2c55b334-8c5d-40e3-83e6-9bc985a2d314 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:55.152906 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-b6d3fb66-f34d-42ca-895d-c13f2b4c902c req-2c55b334-8c5d-40e3-83e6-9bc985a2d314 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:55.181374 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-b6d3fb66-f34d-42ca-895d-c13f2b4c902c req-2c55b334-8c5d-40e3-83e6-9bc985a2d314 service nova] Creating event network-vif-plugged:3c265e4a-7314-4d99-a248-2eb055ab90c0 for instance 446cfa38-0982-47b2-8e3f-a44a35257447 on hv-cinder-84517 Aug 01 14:10:55.229856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-b6d3fb66-f34d-42ca-895d-c13f2b4c902c req-2c55b334-8c5d-40e3-83e6-9bc985a2d314 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100555 Aug 01 14:10:55.232672 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 113/230] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:10:55.461651 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bdf0b84c-5878-4bd4-be74-6469da4b93ec tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:55.480032 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bdf0b84c-5878-4bd4-be74-6469da4b93ec tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:55.588232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bdf0b84c-5878-4bd4-be74-6469da4b93ec tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:55.603881 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bdf0b84c-5878-4bd4-be74-6469da4b93ec tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:55.614499 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bdf0b84c-5878-4bd4-be74-6469da4b93ec tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:55.620994 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bdf0b84c-5878-4bd4-be74-6469da4b93ec tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:56.936957 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bdf0b84c-5878-4bd4-be74-6469da4b93ec tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:56.971815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bdf0b84c-5878-4bd4-be74-6469da4b93ec tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 1.543868 Aug 01 14:10:56.996840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 114/231] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:55 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:57.009884 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2e4e5ad3-c331-42bb-b9c2-ad2fe5f7debd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:57.017537 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2e4e5ad3-c331-42bb-b9c2-ad2fe5f7debd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:57.020160 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=4 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:57.038676 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2e4e5ad3-c331-42bb-b9c2-ad2fe5f7debd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:57.041769 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2e4e5ad3-c331-42bb-b9c2-ad2fe5f7debd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:57.042870 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2e4e5ad3-c331-42bb-b9c2-ad2fe5f7debd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:57.046148 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2e4e5ad3-c331-42bb-b9c2-ad2fe5f7debd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:57.478834 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:57.518578 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:57.524827 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:57.537245 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-733452df-dd47-4c81-b75d-1209beae9866 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1408 microversion: 2.20 time: 3.129106 Aug 01 14:10:57.541215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 118/232] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:54 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1408 bytes in 3137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:58.015896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0c887a6b-ff16-4563-82b7-e45e61d15781 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:58.027859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0c887a6b-ff16-4563-82b7-e45e61d15781 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:58.066720 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c887a6b-ff16-4563-82b7-e45e61d15781 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.071506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c887a6b-ff16-4563-82b7-e45e61d15781 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:58.074103 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c887a6b-ff16-4563-82b7-e45e61d15781 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.081761 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c887a6b-ff16-4563-82b7-e45e61d15781 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:58.385405 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2e4e5ad3-c331-42bb-b9c2-ad2fe5f7debd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:58.397595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2e4e5ad3-c331-42bb-b9c2-ad2fe5f7debd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1713 microversion: 2.1 time: 1.398997 Aug 01 14:10:58.398389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 115/233] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:56 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1713 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:58.571057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:58.571679 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:58.608579 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.609747 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:58.611859 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.612754 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:59.215056 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0c887a6b-ff16-4563-82b7-e45e61d15781 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:59.236088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0c887a6b-ff16-4563-82b7-e45e61d15781 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 1.231062 Aug 01 14:10:59.250426 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 119/234] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:58 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:59.263677 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-7c0fa581-7e15-417e-808e-01341a5a9342 req-1da64495-d047-450c-93b2-74cdd0df9271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11762d81-47fb-42e8-9d2b-4e48b1019eb1", "tag": "529f6efa-aa05-403b-8226-179cf86fc3e3"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:59.285005 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-7c0fa581-7e15-417e-808e-01341a5a9342 req-1da64495-d047-450c-93b2-74cdd0df9271 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:59.286006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-7c0fa581-7e15-417e-808e-01341a5a9342 req-1da64495-d047-450c-93b2-74cdd0df9271 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:59.322952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-7c0fa581-7e15-417e-808e-01341a5a9342 req-1da64495-d047-450c-93b2-74cdd0df9271 service nova] Creating event network-changed:529f6efa-aa05-403b-8226-179cf86fc3e3 for instance 11762d81-47fb-42e8-9d2b-4e48b1019eb1 on hv-cinder-84517 Aug 01 14:10:59.334319 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-7c0fa581-7e15-417e-808e-01341a5a9342 req-1da64495-d047-450c-93b2-74cdd0df9271 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076892 Aug 01 14:10:59.336167 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 120/235] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:59.346530 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6cae11ff-4739-4330-8e82-d221ced75e89 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Action: 'create', calling method: .version_select at 0x7fc57990d3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-384530358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4mA3rHwYe5pigzSraJ5LT5owhw66PwviX2rjQbqGTIx9roF+lQTtkm8t1a5HjMR74Y6ps3dyfMzrihnuQ9k2GNflYQ5Ed8ijj9hEjIVmZGbwhuTek6vIprV/UrkW+ICQ=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:59.361871 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:59.376542 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-6cae11ff-4739-4330-8e82-d221ced75e89 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Getting quotas for project 9d78f1cca2f845a5ad90c514c2d71f62. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:59.385142 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:59.388515 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-6cae11ff-4739-4330-8e82-d221ced75e89 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Getting quotas for user ec40d75e772442d2a97e9bf18b4b90c8 and project 9d78f1cca2f845a5ad90c514c2d71f62. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:59.390023 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:59.393320 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-49f3e4d0-3b69-46dc-91df-99c0c12a9211 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1408 microversion: 2.20 time: 0.826948 Aug 01 14:10:59.410246 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 116/236] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:58 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1408 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:59.463204 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6cae11ff-4739-4330-8e82-d221ced75e89 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.125072 Aug 01 14:10:59.478812 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 121/237] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:10:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:59.719659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-156855330", "imageRef": "bf3e2830-fbb0-44fa-99c4-2066214e31ef", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-384530358", "networks": [{"uuid": "a3e89c87-ac62-4ca6-89ca-ffc32d9ae0f8"}]}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:59.854260 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] validate_networks() for [('a3e89c87-ac62-4ca6-89ca-ffc32d9ae0f8', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:11:00.273925 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-03c79410-835d-4051-8c04-62284468138f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:00.275408 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-03c79410-835d-4051-8c04-62284468138f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:00.283169 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-03c79410-835d-4051-8c04-62284468138f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.285016 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-03c79410-835d-4051-8c04-62284468138f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:00.289821 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-03c79410-835d-4051-8c04-62284468138f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.292186 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-03c79410-835d-4051-8c04-62284468138f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:00.790472 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-03c79410-835d-4051-8c04-62284468138f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:00.810002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-03c79410-835d-4051-8c04-62284468138f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 0.541090 Aug 01 14:11:00.818133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 122/238] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:00 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:00.830724 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:00.832066 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:00.847400 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.859442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:00.863734 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.864548 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:01.810108 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:11:01.811146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:11:01.811628 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:11:01.812034 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:11:01.812568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:11:01.826166 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:01.836620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:01.837069 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:01.841394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:01.841770 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:01.848349 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:01.858488 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:01.867668 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1f47d1a2-ca5b-4bd5-b384-01cf64cda8df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1600 microversion: 2.20 time: 1.043277 Aug 01 14:11:01.869797 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 123/239] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:11:00 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1600 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:11:01.889171 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Getting quotas for project 9d78f1cca2f845a5ad90c514c2d71f62. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:01.894032 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1006625871", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a282ca18-1470-4a11-b809-f055c3b48a10"}], "security_groups": [{"name": "tempest-securitygroup--1336072047"}], "key_name": "tempest-keypair-1620377446", "user_data": "}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:01.908234 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Getting quotas for user ec40d75e772442d2a97e9bf18b4b90c8 and project 9d78f1cca2f845a5ad90c514c2d71f62. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:01.919398 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:01.939582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:11:01.944991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf3e2830-fbb0-44fa-99c4-2066214e31ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:11:02.042575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5c466d8d-2853-436a-ae90-2f954a0fbeb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.329643 Aug 01 14:11:02.043693 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 117/240] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:10:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:11:02.053704 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3488b932-e5c4-4fdf-920a-2a52fb0eddde tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:02.055005 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3488b932-e5c4-4fdf-920a-2a52fb0eddde tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:02.080199 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3488b932-e5c4-4fdf-920a-2a52fb0eddde tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:02.080735 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3488b932-e5c4-4fdf-920a-2a52fb0eddde tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:02.081643 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3488b932-e5c4-4fdf-920a-2a52fb0eddde tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:02.082083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3488b932-e5c4-4fdf-920a-2a52fb0eddde tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:02.103178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:02.206489 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] validate_networks() for [('a282ca18-1470-4a11-b809-f055c3b48a10', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:11:02.617750 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3488b932-e5c4-4fdf-920a-2a52fb0eddde tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:02.627750 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3488b932-e5c4-4fdf-920a-2a52fb0eddde tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 0.582697 Aug 01 14:11:02.641169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 118/241] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:02 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:02.673165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-dbc9246f-0d0b-47b3-ab3d-b4757e27c756 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:02.690449 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-dbc9246f-0d0b-47b3-ab3d-b4757e27c756 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:02.727560 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dbc9246f-0d0b-47b3-ab3d-b4757e27c756 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:02.739267 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dbc9246f-0d0b-47b3-ab3d-b4757e27c756 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:02.741680 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dbc9246f-0d0b-47b3-ab3d-b4757e27c756 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:02.742832 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-dbc9246f-0d0b-47b3-ab3d-b4757e27c756 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:03.024048 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-dbc9246f-0d0b-47b3-ab3d-b4757e27c756 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.374952 Aug 01 14:11:03.027093 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 119/242] 10.222.0.45 () {60 vars in 1316 bytes} [Mon Aug 1 14:11:02 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-interface => generated 284 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:11:03.046224 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4bffeadc-60bd-427a-8bcd-3f31447b9d85 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:03.054049 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4bffeadc-60bd-427a-8bcd-3f31447b9d85 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:03.057880 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:03.975432 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4bffeadc-60bd-427a-8bcd-3f31447b9d85 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:03.983918 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4bffeadc-60bd-427a-8bcd-3f31447b9d85 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1257 microversion: 2.1 time: 0.954956 Aug 01 14:11:04.021176 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 120/243] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:03 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1257 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:04.034081 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4fa2167b-f5bd-4016-b5cd-0027ad1caec2 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:04.035101 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4fa2167b-f5bd-4016-b5cd-0027ad1caec2 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:04.054801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4fa2167b-f5bd-4016-b5cd-0027ad1caec2 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:04.055249 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4fa2167b-f5bd-4016-b5cd-0027ad1caec2 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:04.056060 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4fa2167b-f5bd-4016-b5cd-0027ad1caec2 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:04.056540 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4fa2167b-f5bd-4016-b5cd-0027ad1caec2 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:05.027256 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:11:05.027899 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:11:05.028731 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:11:05.029343 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:11:05.029770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:11:05.058499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:05.060554 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:05.070636 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:05.071094 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:05.125281 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4fa2167b-f5bd-4016-b5cd-0027ad1caec2 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:05.144208 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Getting quotas for project e85f3e6c18ae4466a1dc3e6464aa18e6. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:05.158822 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Getting quotas for user a3e93dfa85244133b1641a431994b47f and project e85f3e6c18ae4466a1dc3e6464aa18e6. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:05.165988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4fa2167b-f5bd-4016-b5cd-0027ad1caec2 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 1.142050 Aug 01 14:11:05.168986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 121/244] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:04 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:05.188112 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ad24db2b-96eb-4c16-888e-559b191d0798 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:05.199168 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ad24db2b-96eb-4c16-888e-559b191d0798 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:05.203758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:11:05.207478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:11:05.233568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ad24db2b-96eb-4c16-888e-559b191d0798 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:05.239951 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ad24db2b-96eb-4c16-888e-559b191d0798 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:05.241941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ad24db2b-96eb-4c16-888e-559b191d0798 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:05.243057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ad24db2b-96eb-4c16-888e-559b191d0798 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:05.323628 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dda10421-ef20-45a6-b7bb-cf28325e02f9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.452177 Aug 01 14:11:05.325777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 124/245] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:11:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 3455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:11:05.340019 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-55155597-fc53-4f53-8098-f6f03fb2e7a8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:05.345291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-55155597-fc53-4f53-8098-f6f03fb2e7a8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:06.513506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-55155597-fc53-4f53-8098-f6f03fb2e7a8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:06.541052 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-55155597-fc53-4f53-8098-f6f03fb2e7a8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1246 microversion: 2.1 time: 1.206009 Aug 01 14:11:06.544567 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 125/246] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:05 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1246 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:06.571087 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6a463b70-9dc6-4421-828d-916e8a9761ef tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:06.575909 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ad24db2b-96eb-4c16-888e-559b191d0798 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:06.578490 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6a463b70-9dc6-4421-828d-916e8a9761ef tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:06.615921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a463b70-9dc6-4421-828d-916e8a9761ef tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:06.619629 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ad24db2b-96eb-4c16-888e-559b191d0798 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1315 microversion: 2.1 time: 1.444777 Aug 01 14:11:06.632981 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a463b70-9dc6-4421-828d-916e8a9761ef tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:06.636662 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a463b70-9dc6-4421-828d-916e8a9761ef tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:06.642006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a463b70-9dc6-4421-828d-916e8a9761ef tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:06.646659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 122/247] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:05 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1315 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:07.576828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-09d6d614-c151-40b8-85fc-80cde64fbafe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:07.587085 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-09d6d614-c151-40b8-85fc-80cde64fbafe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:07.624800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-09d6d614-c151-40b8-85fc-80cde64fbafe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:07.629187 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-09d6d614-c151-40b8-85fc-80cde64fbafe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:07.633406 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-09d6d614-c151-40b8-85fc-80cde64fbafe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:07.640530 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-09d6d614-c151-40b8-85fc-80cde64fbafe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:08.813567 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6a463b70-9dc6-4421-828d-916e8a9761ef tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:08.826065 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6a463b70-9dc6-4421-828d-916e8a9761ef tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 2.274800 Aug 01 14:11:08.832208 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 126/248] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:06 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:08.841376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-81d98c86-1a6f-4371-a502-9c2a7cf9ba4c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:08.846361 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-81d98c86-1a6f-4371-a502-9c2a7cf9ba4c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:08.871997 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-09d6d614-c151-40b8-85fc-80cde64fbafe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:08.881755 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81d98c86-1a6f-4371-a502-9c2a7cf9ba4c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:08.886499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81d98c86-1a6f-4371-a502-9c2a7cf9ba4c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:08.909184 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81d98c86-1a6f-4371-a502-9c2a7cf9ba4c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:08.913586 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81d98c86-1a6f-4371-a502-9c2a7cf9ba4c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:08.938365 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-09d6d614-c151-40b8-85fc-80cde64fbafe tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1242 microversion: 2.1 time: 1.370199 Aug 01 14:11:08.951861 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 123/249] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:07 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1242 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:08.979462 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-300c21cd-26a1-4f0a-a684-46435cd7080b req-c7a26e76-ea39-4e23-a335-080979a76ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11762d81-47fb-42e8-9d2b-4e48b1019eb1", "name": "network-vif-plugged", "status": "completed", "tag": "529f6efa-aa05-403b-8226-179cf86fc3e3"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:09.036129 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-300c21cd-26a1-4f0a-a684-46435cd7080b req-c7a26e76-ea39-4e23-a335-080979a76ae7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:09.036897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-300c21cd-26a1-4f0a-a684-46435cd7080b req-c7a26e76-ea39-4e23-a335-080979a76ae7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:09.100362 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-300c21cd-26a1-4f0a-a684-46435cd7080b req-c7a26e76-ea39-4e23-a335-080979a76ae7 service nova] Creating event network-vif-plugged:529f6efa-aa05-403b-8226-179cf86fc3e3 for instance 11762d81-47fb-42e8-9d2b-4e48b1019eb1 on hv-cinder-84517 Aug 01 14:11:09.120050 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-300c21cd-26a1-4f0a-a684-46435cd7080b req-c7a26e76-ea39-4e23-a335-080979a76ae7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165526 Aug 01 14:11:09.129918 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 124/250] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:09.358245 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-81d98c86-1a6f-4371-a502-9c2a7cf9ba4c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:09.369940 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-81d98c86-1a6f-4371-a502-9c2a7cf9ba4c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1315 microversion: 2.1 time: 0.532522 Aug 01 14:11:09.376895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 127/251] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:08 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:09.878446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-23cf675a-daa8-4969-995e-dd4e76cd09e9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:09.881738 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-23cf675a-daa8-4969-995e-dd4e76cd09e9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:09.911467 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-23cf675a-daa8-4969-995e-dd4e76cd09e9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:09.917584 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-23cf675a-daa8-4969-995e-dd4e76cd09e9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:09.918948 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-23cf675a-daa8-4969-995e-dd4e76cd09e9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:09.919717 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-23cf675a-daa8-4969-995e-dd4e76cd09e9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:09.981238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d2a8e5a2-f759-475f-9deb-b40d1fafdaf1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:09.982780 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d2a8e5a2-f759-475f-9deb-b40d1fafdaf1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:10.000599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2a8e5a2-f759-475f-9deb-b40d1fafdaf1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.002034 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2a8e5a2-f759-475f-9deb-b40d1fafdaf1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.003660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2a8e5a2-f759-475f-9deb-b40d1fafdaf1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.009050 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2a8e5a2-f759-475f-9deb-b40d1fafdaf1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.279250 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d2a8e5a2-f759-475f-9deb-b40d1fafdaf1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:10.299488 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d2a8e5a2-f759-475f-9deb-b40d1fafdaf1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1316 microversion: 2.1 time: 0.323309 Aug 01 14:11:10.307605 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 128/252] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:09 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:10.313059 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-de914ba4-5fed-4404-b48a-f545dcbb58a5 req-ed0d924c-3b2b-487e-a9e2-a65dd0e4e18e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446cfa38-0982-47b2-8e3f-a44a35257447", "tag": "3c265e4a-7314-4d99-a248-2eb055ab90c0"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:10.371382 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-de914ba4-5fed-4404-b48a-f545dcbb58a5 req-ed0d924c-3b2b-487e-a9e2-a65dd0e4e18e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.372098 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-de914ba4-5fed-4404-b48a-f545dcbb58a5 req-ed0d924c-3b2b-487e-a9e2-a65dd0e4e18e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.389123 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-de914ba4-5fed-4404-b48a-f545dcbb58a5 req-ed0d924c-3b2b-487e-a9e2-a65dd0e4e18e service nova] Creating event network-changed:3c265e4a-7314-4d99-a248-2eb055ab90c0 for instance 446cfa38-0982-47b2-8e3f-a44a35257447 on hv-cinder-84517 Aug 01 14:11:10.405337 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-de914ba4-5fed-4404-b48a-f545dcbb58a5 req-ed0d924c-3b2b-487e-a9e2-a65dd0e4e18e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095543 Aug 01 14:11:10.406719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 129/253] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:10.419983 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1f20eaa7-4b67-45f0-9091-cbc33d9c3e70 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:10.421057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1f20eaa7-4b67-45f0-9091-cbc33d9c3e70 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:10.428491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f20eaa7-4b67-45f0-9091-cbc33d9c3e70 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.429221 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f20eaa7-4b67-45f0-9091-cbc33d9c3e70 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.430542 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f20eaa7-4b67-45f0-9091-cbc33d9c3e70 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.431162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f20eaa7-4b67-45f0-9091-cbc33d9c3e70 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.600933 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-23cf675a-daa8-4969-995e-dd4e76cd09e9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:10.644143 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-23cf675a-daa8-4969-995e-dd4e76cd09e9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 0.781202 Aug 01 14:11:10.666976 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 125/254] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:09 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:10.922714 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1f20eaa7-4b67-45f0-9091-cbc33d9c3e70 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:10.944549 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1f20eaa7-4b67-45f0-9091-cbc33d9c3e70 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.535256 Aug 01 14:11:10.946349 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 130/255] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:10 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:11.350143 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3fae1c5d-bc39-4f06-a5c4-101c61b7caa2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:11.352534 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3fae1c5d-bc39-4f06-a5c4-101c61b7caa2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:11.366920 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3fae1c5d-bc39-4f06-a5c4-101c61b7caa2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.368501 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3fae1c5d-bc39-4f06-a5c4-101c61b7caa2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.371846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3fae1c5d-bc39-4f06-a5c4-101c61b7caa2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.373594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3fae1c5d-bc39-4f06-a5c4-101c61b7caa2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.504505 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3fae1c5d-bc39-4f06-a5c4-101c61b7caa2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:11.524212 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3fae1c5d-bc39-4f06-a5c4-101c61b7caa2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1316 microversion: 2.1 time: 0.183717 Aug 01 14:11:11.525665 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 126/256] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:11 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:11.695165 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8efbb3e5-a680-43bd-a867-8108fd4bfb30 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:11.697239 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8efbb3e5-a680-43bd-a867-8108fd4bfb30 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:11.727073 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8efbb3e5-a680-43bd-a867-8108fd4bfb30 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.728060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8efbb3e5-a680-43bd-a867-8108fd4bfb30 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.730441 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8efbb3e5-a680-43bd-a867-8108fd4bfb30 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.731466 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8efbb3e5-a680-43bd-a867-8108fd4bfb30 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.981844 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4bd02c91-8234-4d7e-baac-b410a1c2f700 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:11.982760 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4bd02c91-8234-4d7e-baac-b410a1c2f700 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:11.996175 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:12.012882 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4bd02c91-8234-4d7e-baac-b410a1c2f700 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.014846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4bd02c91-8234-4d7e-baac-b410a1c2f700 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.015897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4bd02c91-8234-4d7e-baac-b410a1c2f700 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.022691 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4bd02c91-8234-4d7e-baac-b410a1c2f700 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.327781 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8efbb3e5-a680-43bd-a867-8108fd4bfb30 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:12.434336 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8efbb3e5-a680-43bd-a867-8108fd4bfb30 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 0.697050 Aug 01 14:11:12.444243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 131/257] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:11 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:12.558433 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9574d9e9-dc53-4fb1-b9ad-091942ab37b2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:12.558951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9574d9e9-dc53-4fb1-b9ad-091942ab37b2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:12.590131 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9574d9e9-dc53-4fb1-b9ad-091942ab37b2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.590593 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9574d9e9-dc53-4fb1-b9ad-091942ab37b2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.591429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9574d9e9-dc53-4fb1-b9ad-091942ab37b2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.591879 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9574d9e9-dc53-4fb1-b9ad-091942ab37b2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.686171 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:13.017447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9574d9e9-dc53-4fb1-b9ad-091942ab37b2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:13.037737 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9574d9e9-dc53-4fb1-b9ad-091942ab37b2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1316 microversion: 2.1 time: 0.481461 Aug 01 14:11:13.072440 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 132/258] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:12 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:13.256759 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4bd02c91-8234-4d7e-baac-b410a1c2f700 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:13.314182 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4bd02c91-8234-4d7e-baac-b410a1c2f700 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 1.323159 Aug 01 14:11:13.330652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 127/259] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:11 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:13.473571 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5594f720-357c-460a-b826-b912a96f7f8b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:13.474979 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5594f720-357c-460a-b826-b912a96f7f8b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:13.498325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5594f720-357c-460a-b826-b912a96f7f8b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.500812 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5594f720-357c-460a-b826-b912a96f7f8b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:13.505595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5594f720-357c-460a-b826-b912a96f7f8b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.513393 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5594f720-357c-460a-b826-b912a96f7f8b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:13.825009 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b135c899-7a75-462f-9738-76b40cd6b5d8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Action: 'create', calling method: .version_select at 0x7fc5798da1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-875785955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvPibdSU1pv+n/ZQvpmJiOCYthZl2fe+7fme4j6Bmnu8hKALYXhQuA7hroXpyMBFXYT/rmvwH2It5IAouZZyz+TOR4iZpXPZiA/o4HBtX1EuGbHGnNwWWSt72rTyRplZw=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:13.891942 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-b135c899-7a75-462f-9738-76b40cd6b5d8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Getting quotas for project 6bfbca571c4b4199a577322e866dfae9. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:13.901926 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-b135c899-7a75-462f-9738-76b40cd6b5d8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Getting quotas for user b4ae8decd5354231bebc7bfda44d3285 and project 6bfbca571c4b4199a577322e866dfae9. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:13.966826 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b135c899-7a75-462f-9738-76b40cd6b5d8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.773372 Aug 01 14:11:13.970282 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 133/260] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:11:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:13.988678 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=8 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:14.080596 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5594f720-357c-460a-b826-b912a96f7f8b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:14.091373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a4d38ff1-5169-432a-a43d-7bd6c5507adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:14.106239 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a4d38ff1-5169-432a-a43d-7bd6c5507adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:14.112976 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5594f720-357c-460a-b826-b912a96f7f8b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 0.644382 Aug 01 14:11:14.135768 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 128/261] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:13 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:14.138035 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4d38ff1-5169-432a-a43d-7bd6c5507adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.145798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4d38ff1-5169-432a-a43d-7bd6c5507adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.146879 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4d38ff1-5169-432a-a43d-7bd6c5507adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.147330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4d38ff1-5169-432a-a43d-7bd6c5507adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.296001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a4d38ff1-5169-432a-a43d-7bd6c5507adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:14.314160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a4d38ff1-5169-432a-a43d-7bd6c5507adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1304 microversion: 2.1 time: 0.226443 Aug 01 14:11:14.316439 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 134/262] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:14 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1304 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:14.342561 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-220fc3c9-2d8b-4c45-9de7-b41e888bb83a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:14.344680 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-220fc3c9-2d8b-4c45-9de7-b41e888bb83a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:14.353616 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-220fc3c9-2d8b-4c45-9de7-b41e888bb83a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.354393 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-220fc3c9-2d8b-4c45-9de7-b41e888bb83a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.355686 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-220fc3c9-2d8b-4c45-9de7-b41e888bb83a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.356317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-220fc3c9-2d8b-4c45-9de7-b41e888bb83a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.697090 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-60e0374a-ae9d-40ca-8571-ff7d08526dcb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Action: 'create', calling method: .version_select at 0x7fc579923550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-923806228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/S8YVZ8xdazpkq5xTbXPn4s9w/Q1lOVt06FEXpodt7PnAd0aNuvRtfSJ18sZN9fQXWrO8EcHlXW1htygL2RvSPE0p1WUQ+Qzy7BukEJmNm2ehs350mecGuviZWQ0ctIQ=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:14.738043 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-60e0374a-ae9d-40ca-8571-ff7d08526dcb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Getting quotas for project f0a6c07d69ef4cf4a545f48e7079044d. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:14.743783 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-60e0374a-ae9d-40ca-8571-ff7d08526dcb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Getting quotas for user 8e30910692b4474092f1585a671e2f41 and project f0a6c07d69ef4cf4a545f48e7079044d. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:14.793565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-60e0374a-ae9d-40ca-8571-ff7d08526dcb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.352100 Aug 01 14:11:14.795761 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 135/263] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:11:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:14.882896 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-220fc3c9-2d8b-4c45-9de7-b41e888bb83a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:14.918208 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-220fc3c9-2d8b-4c45-9de7-b41e888bb83a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.579756 Aug 01 14:11:14.919319 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 129/264] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:14 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:15.138060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:15.142873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-72d6ab0b-8b5f-4634-9502-4ae5a923711e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:15.143667 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-72d6ab0b-8b5f-4634-9502-4ae5a923711e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:15.155188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72d6ab0b-8b5f-4634-9502-4ae5a923711e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.155854 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72d6ab0b-8b5f-4634-9502-4ae5a923711e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.157696 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72d6ab0b-8b5f-4634-9502-4ae5a923711e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.158350 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72d6ab0b-8b5f-4634-9502-4ae5a923711e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.191239 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-fdaec33e-3050-4e46-9e14-555caf094f7f req-185945d5-e591-436b-a5ec-dd4c23278d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dd2869-e1f8-4607-8fc8-63858730bcc3", "tag": "1bf0befb-0ac8-4221-a091-92283e46d506"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:15.225740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-fdaec33e-3050-4e46-9e14-555caf094f7f req-185945d5-e591-436b-a5ec-dd4c23278d34 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.227699 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-fdaec33e-3050-4e46-9e14-555caf094f7f req-185945d5-e591-436b-a5ec-dd4c23278d34 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.258372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-fdaec33e-3050-4e46-9e14-555caf094f7f req-185945d5-e591-436b-a5ec-dd4c23278d34 service nova] Creating event network-changed:1bf0befb-0ac8-4221-a091-92283e46d506 for instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 on hv-cinder-84517 Aug 01 14:11:15.264611 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-fdaec33e-3050-4e46-9e14-555caf094f7f req-185945d5-e591-436b-a5ec-dd4c23278d34 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081792 Aug 01 14:11:15.266000 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 130/265] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:15.354040 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-48de9fe2-d21f-48f7-9be1-fccae6b202ec tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:15.359262 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-48de9fe2-d21f-48f7-9be1-fccae6b202ec tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:15.390411 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48de9fe2-d21f-48f7-9be1-fccae6b202ec tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.391738 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48de9fe2-d21f-48f7-9be1-fccae6b202ec tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.393833 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48de9fe2-d21f-48f7-9be1-fccae6b202ec tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.395462 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48de9fe2-d21f-48f7-9be1-fccae6b202ec tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.720978 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-48de9fe2-d21f-48f7-9be1-fccae6b202ec tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:15.768604 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-48de9fe2-d21f-48f7-9be1-fccae6b202ec tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1304 microversion: 2.1 time: 0.421434 Aug 01 14:11:15.798724 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 131/266] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:15 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1304 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:15.947397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-7cb8482f-0d30-4144-a35b-ae1580c52c6d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:15.952460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-7cb8482f-0d30-4144-a35b-ae1580c52c6d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:15.992459 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7cb8482f-0d30-4144-a35b-ae1580c52c6d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.994177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7cb8482f-0d30-4144-a35b-ae1580c52c6d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.997340 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7cb8482f-0d30-4144-a35b-ae1580c52c6d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.998610 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7cb8482f-0d30-4144-a35b-ae1580c52c6d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.046180 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-72d6ab0b-8b5f-4634-9502-4ae5a923711e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:16.084359 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-72d6ab0b-8b5f-4634-9502-4ae5a923711e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 0.946667 Aug 01 14:11:16.085859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 136/267] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:15 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:16.631316 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-7cb8482f-0d30-4144-a35b-ae1580c52c6d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:16.668170 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-7cb8482f-0d30-4144-a35b-ae1580c52c6d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.723572 Aug 01 14:11:16.684312 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 132/268] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:15 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:16.834306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f89e539c-9155-48e7-bacc-28a32b7983a7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:16.840108 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f89e539c-9155-48e7-bacc-28a32b7983a7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:16.888360 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f89e539c-9155-48e7-bacc-28a32b7983a7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.889772 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f89e539c-9155-48e7-bacc-28a32b7983a7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.891810 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f89e539c-9155-48e7-bacc-28a32b7983a7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.892936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f89e539c-9155-48e7-bacc-28a32b7983a7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.121807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-92bc7f54-86fa-497b-8241-42272cf8cafa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:17.122797 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-92bc7f54-86fa-497b-8241-42272cf8cafa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:17.147279 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92bc7f54-86fa-497b-8241-42272cf8cafa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.175135 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92bc7f54-86fa-497b-8241-42272cf8cafa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.177392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92bc7f54-86fa-497b-8241-42272cf8cafa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.180356 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92bc7f54-86fa-497b-8241-42272cf8cafa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.264852 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f89e539c-9155-48e7-bacc-28a32b7983a7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:17.332434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f89e539c-9155-48e7-bacc-28a32b7983a7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1304 microversion: 2.1 time: 0.518840 Aug 01 14:11:17.338568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 137/269] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:16 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1304 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:17.713617 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-141f7022-b22a-4384-9c53-704642d5161e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:17.718973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-141f7022-b22a-4384-9c53-704642d5161e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:17.748234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-141f7022-b22a-4384-9c53-704642d5161e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.750102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-141f7022-b22a-4384-9c53-704642d5161e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.756220 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-141f7022-b22a-4384-9c53-704642d5161e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.757680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-141f7022-b22a-4384-9c53-704642d5161e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:18.071136 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-92bc7f54-86fa-497b-8241-42272cf8cafa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:18.083762 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-92bc7f54-86fa-497b-8241-42272cf8cafa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 0.967034 Aug 01 14:11:18.097278 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 133/270] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:17 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:18.369651 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5268cd32-025b-4581-a620-35d9e6f2e077 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:18.370618 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5268cd32-025b-4581-a620-35d9e6f2e077 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:18.416566 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5268cd32-025b-4581-a620-35d9e6f2e077 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:18.417582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5268cd32-025b-4581-a620-35d9e6f2e077 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:18.419894 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5268cd32-025b-4581-a620-35d9e6f2e077 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:18.427316 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5268cd32-025b-4581-a620-35d9e6f2e077 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:18.549500 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-141f7022-b22a-4384-9c53-704642d5161e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:18.592778 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-141f7022-b22a-4384-9c53-704642d5161e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.887057 Aug 01 14:11:18.593856 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 138/271] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:17 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:18.686706 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5268cd32-025b-4581-a620-35d9e6f2e077 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:18.699811 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5268cd32-025b-4581-a620-35d9e6f2e077 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1304 microversion: 2.1 time: 0.334620 Aug 01 14:11:18.713333 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 134/272] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:18 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1304 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:19.129581 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ecf7776f-cd79-40c6-9f36-fdbd16778bf0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:19.131702 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ecf7776f-cd79-40c6-9f36-fdbd16778bf0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:19.150594 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecf7776f-cd79-40c6-9f36-fdbd16778bf0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.151049 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecf7776f-cd79-40c6-9f36-fdbd16778bf0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.155071 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecf7776f-cd79-40c6-9f36-fdbd16778bf0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.155530 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecf7776f-cd79-40c6-9f36-fdbd16778bf0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.613772 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ecf7776f-cd79-40c6-9f36-fdbd16778bf0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:19.622455 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-02257d9f-0efe-43a9-8a8a-b1f638ac0f44 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:19.623453 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-02257d9f-0efe-43a9-8a8a-b1f638ac0f44 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:19.635583 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ecf7776f-cd79-40c6-9f36-fdbd16778bf0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 0.511545 Aug 01 14:11:19.638532 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-02257d9f-0efe-43a9-8a8a-b1f638ac0f44 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.638985 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-02257d9f-0efe-43a9-8a8a-b1f638ac0f44 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.645779 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-02257d9f-0efe-43a9-8a8a-b1f638ac0f44 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.646512 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-02257d9f-0efe-43a9-8a8a-b1f638ac0f44 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.650801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 139/273] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:19 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:19.739541 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-39fc93c8-7019-42db-ae30-6623385a0ce8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:19.741388 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-39fc93c8-7019-42db-ae30-6623385a0ce8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:19.756155 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39fc93c8-7019-42db-ae30-6623385a0ce8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.757410 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39fc93c8-7019-42db-ae30-6623385a0ce8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.759065 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39fc93c8-7019-42db-ae30-6623385a0ce8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.760141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39fc93c8-7019-42db-ae30-6623385a0ce8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.941357 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-02257d9f-0efe-43a9-8a8a-b1f638ac0f44 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:19.957393 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-02257d9f-0efe-43a9-8a8a-b1f638ac0f44 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.339231 Aug 01 14:11:19.959029 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 135/274] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:19 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:20.085386 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-39fc93c8-7019-42db-ae30-6623385a0ce8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:20.101362 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-39fc93c8-7019-42db-ae30-6623385a0ce8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.377491 Aug 01 14:11:20.118042 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 140/275] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:19 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:20.662913 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0eb20684-4634-4365-bb9a-37767d36ddbe tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:20.663948 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0eb20684-4634-4365-bb9a-37767d36ddbe tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:20.695149 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0eb20684-4634-4365-bb9a-37767d36ddbe tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:20.698509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0eb20684-4634-4365-bb9a-37767d36ddbe tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:20.703128 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0eb20684-4634-4365-bb9a-37767d36ddbe tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:20.703890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0eb20684-4634-4365-bb9a-37767d36ddbe tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:20.990636 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4512b8d7-3d72-4093-9363-1712843d1441 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:20.991387 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4512b8d7-3d72-4093-9363-1712843d1441 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:21.004074 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0eb20684-4634-4365-bb9a-37767d36ddbe tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:21.016258 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0eb20684-4634-4365-bb9a-37767d36ddbe tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1313 microversion: 2.1 time: 0.360309 Aug 01 14:11:21.017518 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4512b8d7-3d72-4093-9363-1712843d1441 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.018162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4512b8d7-3d72-4093-9363-1712843d1441 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.030119 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 136/276] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:20 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:21.032018 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4512b8d7-3d72-4093-9363-1712843d1441 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.037348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4512b8d7-3d72-4093-9363-1712843d1441 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.132419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-fa9feda3-8d6d-4798-bcc6-211c41ef7adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:21.133930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-fa9feda3-8d6d-4798-bcc6-211c41ef7adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:21.144953 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fa9feda3-8d6d-4798-bcc6-211c41ef7adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.145998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fa9feda3-8d6d-4798-bcc6-211c41ef7adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.147607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fa9feda3-8d6d-4798-bcc6-211c41ef7adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.148504 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fa9feda3-8d6d-4798-bcc6-211c41ef7adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.322464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4512b8d7-3d72-4093-9363-1712843d1441 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:21.340956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4512b8d7-3d72-4093-9363-1712843d1441 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.356175 Aug 01 14:11:21.343203 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 141/277] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:20 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:21.440213 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-fa9feda3-8d6d-4798-bcc6-211c41ef7adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:21.444040 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=100 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:21.464114 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-fa9feda3-8d6d-4798-bcc6-211c41ef7adc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.340665 Aug 01 14:11:21.466534 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 137/278] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:21 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:22.045742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-140562a2-a9c1-42a3-93be-d0eb8d27948d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:22.046547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-140562a2-a9c1-42a3-93be-d0eb8d27948d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:22.080443 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-140562a2-a9c1-42a3-93be-d0eb8d27948d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.082083 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-140562a2-a9c1-42a3-93be-d0eb8d27948d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.083770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-140562a2-a9c1-42a3-93be-d0eb8d27948d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.084941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-140562a2-a9c1-42a3-93be-d0eb8d27948d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.376736 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-99d61c51-ef2c-4597-a9e6-79ea1c62538b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:22.378520 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-99d61c51-ef2c-4597-a9e6-79ea1c62538b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:22.396250 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d61c51-ef2c-4597-a9e6-79ea1c62538b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.402146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d61c51-ef2c-4597-a9e6-79ea1c62538b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.404377 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d61c51-ef2c-4597-a9e6-79ea1c62538b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.407509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d61c51-ef2c-4597-a9e6-79ea1c62538b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.697583 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-140562a2-a9c1-42a3-93be-d0eb8d27948d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:22.751245 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-140562a2-a9c1-42a3-93be-d0eb8d27948d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1498 microversion: 2.1 time: 0.708955 Aug 01 14:11:22.752184 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 142/279] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:22 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1498 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:22.792262 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f10da0fc-e7a5-4596-bfaf-efbad5a291c6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:22.812959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f10da0fc-e7a5-4596-bfaf-efbad5a291c6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:22.878886 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f10da0fc-e7a5-4596-bfaf-efbad5a291c6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.888946 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f10da0fc-e7a5-4596-bfaf-efbad5a291c6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.898774 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f10da0fc-e7a5-4596-bfaf-efbad5a291c6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.899215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f10da0fc-e7a5-4596-bfaf-efbad5a291c6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:23.915780 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-99d61c51-ef2c-4597-a9e6-79ea1c62538b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:23.928091 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-99d61c51-ef2c-4597-a9e6-79ea1c62538b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 1.555963 Aug 01 14:11:23.938543 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 138/280] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:22 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:24.011121 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f10da0fc-e7a5-4596-bfaf-efbad5a291c6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:24.025727 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f10da0fc-e7a5-4596-bfaf-efbad5a291c6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 1.263992 Aug 01 14:11:24.026202 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-cab4bb25-2a7b-43de-8158-baa32dd6c2c8 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:24.026708 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-cab4bb25-2a7b-43de-8158-baa32dd6c2c8 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:24.034531 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cab4bb25-2a7b-43de-8158-baa32dd6c2c8 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.035237 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cab4bb25-2a7b-43de-8158-baa32dd6c2c8 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.036043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cab4bb25-2a7b-43de-8158-baa32dd6c2c8 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.036516 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cab4bb25-2a7b-43de-8158-baa32dd6c2c8 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.038316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 143/281] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:22 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:24.106210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-cab4bb25-2a7b-43de-8158-baa32dd6c2c8 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:11:24.443077 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-cab4bb25-2a7b-43de-8158-baa32dd6c2c8 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "DELETE /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 204 len: 0 microversion: 2.1 time: 0.420506 Aug 01 14:11:24.454993 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 139/282] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:11:24 2022] DELETE /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:11:24.460436 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-637d1853-afb3-4469-b81b-557f5f7a826e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:24.461093 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-637d1853-afb3-4469-b81b-557f5f7a826e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:24.477089 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-637d1853-afb3-4469-b81b-557f5f7a826e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.477665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-637d1853-afb3-4469-b81b-557f5f7a826e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.478486 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-637d1853-afb3-4469-b81b-557f5f7a826e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.478920 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-637d1853-afb3-4469-b81b-557f5f7a826e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.870152 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=20 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:24.965853 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-7cb45811-c745-448e-8d66-565340336449 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:24.970023 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-7cb45811-c745-448e-8d66-565340336449 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:25.010904 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7cb45811-c745-448e-8d66-565340336449 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:25.012516 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7cb45811-c745-448e-8d66-565340336449 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.015461 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7cb45811-c745-448e-8d66-565340336449 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:25.017698 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7cb45811-c745-448e-8d66-565340336449 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.123909 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-637d1853-afb3-4469-b81b-557f5f7a826e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:25.132803 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-637d1853-afb3-4469-b81b-557f5f7a826e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1504 microversion: 2.1 time: 0.676496 Aug 01 14:11:25.153787 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 144/283] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:24 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1504 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:25.164500 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-547be22e-2c07-4564-88d2-d8197551c1a6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:25.164500 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-547be22e-2c07-4564-88d2-d8197551c1a6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:25.185963 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-547be22e-2c07-4564-88d2-d8197551c1a6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:25.186823 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-547be22e-2c07-4564-88d2-d8197551c1a6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.187894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-547be22e-2c07-4564-88d2-d8197551c1a6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:25.200863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-547be22e-2c07-4564-88d2-d8197551c1a6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.671450 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-7cb45811-c745-448e-8d66-565340336449 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:25.687977 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-547be22e-2c07-4564-88d2-d8197551c1a6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:25.703711 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-7cb45811-c745-448e-8d66-565340336449 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.752962 Aug 01 14:11:25.720708 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 140/284] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:24 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:25.727218 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-547be22e-2c07-4564-88d2-d8197551c1a6 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.571520 Aug 01 14:11:25.731634 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-9050b47f-0d4f-489a-bf1d-6a8f7c8c31ec req-683b88e2-4522-4ff4-87c8-2d360a504767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69e5d2d-0483-4373-aa71-ea2305f287d3", "tag": "03542f14-88d5-4bf6-9c7d-0dcbe18589a5"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:25.752560 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 145/285] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:25 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:25.761494 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-9050b47f-0d4f-489a-bf1d-6a8f7c8c31ec req-683b88e2-4522-4ff4-87c8-2d360a504767 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:25.762639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-9050b47f-0d4f-489a-bf1d-6a8f7c8c31ec req-683b88e2-4522-4ff4-87c8-2d360a504767 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.788936 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-9050b47f-0d4f-489a-bf1d-6a8f7c8c31ec req-683b88e2-4522-4ff4-87c8-2d360a504767 service nova] Creating event network-changed:03542f14-88d5-4bf6-9c7d-0dcbe18589a5 for instance b69e5d2d-0483-4373-aa71-ea2305f287d3 on hv-cinder-84517 Aug 01 14:11:25.797245 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-9050b47f-0d4f-489a-bf1d-6a8f7c8c31ec req-683b88e2-4522-4ff4-87c8-2d360a504767 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073734 Aug 01 14:11:25.798767 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 141/286] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:26.224353 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a6f79707-3654-437b-b987-6cab33ff4eb1 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:26.225405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a6f79707-3654-437b-b987-6cab33ff4eb1 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:26.246931 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6f79707-3654-437b-b987-6cab33ff4eb1 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.247396 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6f79707-3654-437b-b987-6cab33ff4eb1 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.248261 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6f79707-3654-437b-b987-6cab33ff4eb1 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.248766 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6f79707-3654-437b-b987-6cab33ff4eb1 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.450859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a6f79707-3654-437b-b987-6cab33ff4eb1 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:26.463770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a6f79707-3654-437b-b987-6cab33ff4eb1 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1504 microversion: 2.1 time: 0.245549 Aug 01 14:11:26.464771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 146/287] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:26 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:26.735467 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c66e47a2-f2c1-4fa2-b750-1d0cae58a6e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:26.738355 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c66e47a2-f2c1-4fa2-b750-1d0cae58a6e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:26.765515 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2b648991-4c4e-48b3-ba21-0d3bc44eb892 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:26.768674 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2b648991-4c4e-48b3-ba21-0d3bc44eb892 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:26.770730 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c66e47a2-f2c1-4fa2-b750-1d0cae58a6e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.771705 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c66e47a2-f2c1-4fa2-b750-1d0cae58a6e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.773521 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c66e47a2-f2c1-4fa2-b750-1d0cae58a6e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.774500 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c66e47a2-f2c1-4fa2-b750-1d0cae58a6e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.779765 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b648991-4c4e-48b3-ba21-0d3bc44eb892 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.780606 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b648991-4c4e-48b3-ba21-0d3bc44eb892 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.781664 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b648991-4c4e-48b3-ba21-0d3bc44eb892 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.782664 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b648991-4c4e-48b3-ba21-0d3bc44eb892 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:27.143784 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2b648991-4c4e-48b3-ba21-0d3bc44eb892 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:27.146975 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c66e47a2-f2c1-4fa2-b750-1d0cae58a6e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:27.153365 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2b648991-4c4e-48b3-ba21-0d3bc44eb892 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.396151 Aug 01 14:11:27.154063 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 147/288] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:26 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:27.173478 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c66e47a2-f2c1-4fa2-b750-1d0cae58a6e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.447845 Aug 01 14:11:27.174282 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 142/289] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:26 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:27.486209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-df243c50-3b8d-4f28-8369-38095b6878fa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:27.486911 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-df243c50-3b8d-4f28-8369-38095b6878fa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:27.493727 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df243c50-3b8d-4f28-8369-38095b6878fa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:27.494168 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df243c50-3b8d-4f28-8369-38095b6878fa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:27.494957 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df243c50-3b8d-4f28-8369-38095b6878fa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:27.495392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df243c50-3b8d-4f28-8369-38095b6878fa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:27.696586 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-df243c50-3b8d-4f28-8369-38095b6878fa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:27.710645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-df243c50-3b8d-4f28-8369-38095b6878fa tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1504 microversion: 2.1 time: 0.228988 Aug 01 14:11:27.711911 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 148/290] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:27 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:28.180087 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-07b9cae6-1697-48be-b6ec-b90cdf6fb7a3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:28.181149 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-07b9cae6-1697-48be-b6ec-b90cdf6fb7a3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:28.190456 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07b9cae6-1697-48be-b6ec-b90cdf6fb7a3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.191192 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07b9cae6-1697-48be-b6ec-b90cdf6fb7a3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.192560 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07b9cae6-1697-48be-b6ec-b90cdf6fb7a3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.193987 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07b9cae6-1697-48be-b6ec-b90cdf6fb7a3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.203012 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2fd3f378-2cfb-4403-962f-e9ac5655a453 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:28.203944 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2fd3f378-2cfb-4403-962f-e9ac5655a453 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:28.211986 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fd3f378-2cfb-4403-962f-e9ac5655a453 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.213372 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fd3f378-2cfb-4403-962f-e9ac5655a453 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.214937 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fd3f378-2cfb-4403-962f-e9ac5655a453 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.215867 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fd3f378-2cfb-4403-962f-e9ac5655a453 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.479441 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-07b9cae6-1697-48be-b6ec-b90cdf6fb7a3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:28.486928 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-07b9cae6-1697-48be-b6ec-b90cdf6fb7a3 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.313513 Aug 01 14:11:28.492186 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 143/291] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:28 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:28.495732 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2fd3f378-2cfb-4403-962f-e9ac5655a453 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:28.508845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2fd3f378-2cfb-4403-962f-e9ac5655a453 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.312881 Aug 01 14:11:28.510118 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 149/292] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:28 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:28.734424 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a9f97245-284a-404d-a086-6ab93766da4d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:28.735055 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a9f97245-284a-404d-a086-6ab93766da4d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:28.741879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a9f97245-284a-404d-a086-6ab93766da4d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.742413 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a9f97245-284a-404d-a086-6ab93766da4d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.743327 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a9f97245-284a-404d-a086-6ab93766da4d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.743814 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a9f97245-284a-404d-a086-6ab93766da4d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.925083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a9f97245-284a-404d-a086-6ab93766da4d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:28.934043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a9f97245-284a-404d-a086-6ab93766da4d tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1504 microversion: 2.1 time: 0.205555 Aug 01 14:11:28.934781 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 144/293] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:28 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:29.516440 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b8e5b8da-c835-4371-b9bc-df0c7f682412 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:29.520241 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b8e5b8da-c835-4371-b9bc-df0c7f682412 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:29.551554 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8e5b8da-c835-4371-b9bc-df0c7f682412 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.553178 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8e5b8da-c835-4371-b9bc-df0c7f682412 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.558330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8e5b8da-c835-4371-b9bc-df0c7f682412 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.559207 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8e5b8da-c835-4371-b9bc-df0c7f682412 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.568435 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-92c620a4-448f-4527-89a4-6b631ae52d6c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:29.570668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-92c620a4-448f-4527-89a4-6b631ae52d6c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:29.591827 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92c620a4-448f-4527-89a4-6b631ae52d6c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.592439 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92c620a4-448f-4527-89a4-6b631ae52d6c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.593384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92c620a4-448f-4527-89a4-6b631ae52d6c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.594220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92c620a4-448f-4527-89a4-6b631ae52d6c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.957954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b8e5b8da-c835-4371-b9bc-df0c7f682412 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:29.972798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b8e5b8da-c835-4371-b9bc-df0c7f682412 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.463501 Aug 01 14:11:29.989658 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 150/294] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:29 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:29.996685 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-92c620a4-448f-4527-89a4-6b631ae52d6c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:29.997675 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-35e50809-73be-4bad-a60b-75775ceeaf7e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:29.998498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-35e50809-73be-4bad-a60b-75775ceeaf7e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:30.008544 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35e50809-73be-4bad-a60b-75775ceeaf7e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:30.013517 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-92c620a4-448f-4527-89a4-6b631ae52d6c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.481293 Aug 01 14:11:30.015201 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 145/295] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:29 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:30.024795 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35e50809-73be-4bad-a60b-75775ceeaf7e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:30.028583 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35e50809-73be-4bad-a60b-75775ceeaf7e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:30.029357 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35e50809-73be-4bad-a60b-75775ceeaf7e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:30.040248 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:30.565686 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-35e50809-73be-4bad-a60b-75775ceeaf7e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:30.580022 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-35e50809-73be-4bad-a60b-75775ceeaf7e tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1504 microversion: 2.1 time: 0.588147 Aug 01 14:11:30.582881 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 151/296] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:29 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1504 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:31.005442 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-50f85592-c4fb-4595-909d-12867be9e7db tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:31.007227 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-50f85592-c4fb-4595-909d-12867be9e7db tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:31.023197 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-50f85592-c4fb-4595-909d-12867be9e7db tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.024440 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-50f85592-c4fb-4595-909d-12867be9e7db tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.025987 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-50f85592-c4fb-4595-909d-12867be9e7db tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.026892 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-50f85592-c4fb-4595-909d-12867be9e7db tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.038093 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a9e47444-e165-4370-8419-791e5545ea79 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:31.039011 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a9e47444-e165-4370-8419-791e5545ea79 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:31.059019 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9e47444-e165-4370-8419-791e5545ea79 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.059799 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9e47444-e165-4370-8419-791e5545ea79 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.060846 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9e47444-e165-4370-8419-791e5545ea79 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.061462 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9e47444-e165-4370-8419-791e5545ea79 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.405550 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a9e47444-e165-4370-8419-791e5545ea79 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:31.416740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-50f85592-c4fb-4595-909d-12867be9e7db tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:31.423843 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a9e47444-e165-4370-8419-791e5545ea79 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.389730 Aug 01 14:11:31.424609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 152/297] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:31 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:31.429672 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-50f85592-c4fb-4595-909d-12867be9e7db tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.431434 Aug 01 14:11:31.430920 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 146/298] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:30 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:31.612506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5ef7652a-93fe-410a-b927-b9298af0cfcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:31.613238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5ef7652a-93fe-410a-b927-b9298af0cfcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:31.621291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5ef7652a-93fe-410a-b927-b9298af0cfcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.621804 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5ef7652a-93fe-410a-b927-b9298af0cfcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.622792 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5ef7652a-93fe-410a-b927-b9298af0cfcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.623217 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5ef7652a-93fe-410a-b927-b9298af0cfcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.675991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-99485bde-4fd7-4874-9a9d-c0115d046be0 req-c7e7fe41-bb63-4a8f-a904-aa2b2e88c07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11762d81-47fb-42e8-9d2b-4e48b1019eb1", "name": "network-vif-deleted", "tag": "529f6efa-aa05-403b-8226-179cf86fc3e3"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:31.689484 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-99485bde-4fd7-4874-9a9d-c0115d046be0 req-c7e7fe41-bb63-4a8f-a904-aa2b2e88c07a service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.689484 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-99485bde-4fd7-4874-9a9d-c0115d046be0 req-c7e7fe41-bb63-4a8f-a904-aa2b2e88c07a service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.699132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5ef7652a-93fe-410a-b927-b9298af0cfcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:31.715927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5ef7652a-93fe-410a-b927-b9298af0cfcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1462 microversion: 2.1 time: 0.104271 Aug 01 14:11:31.717225 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 153/299] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:31 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1462 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:31.720800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-99485bde-4fd7-4874-9a9d-c0115d046be0 req-c7e7fe41-bb63-4a8f-a904-aa2b2e88c07a service nova] Creating event network-vif-deleted:529f6efa-aa05-403b-8226-179cf86fc3e3 for instance 11762d81-47fb-42e8-9d2b-4e48b1019eb1 on hv-cinder-84517 Aug 01 14:11:31.726989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-99485bde-4fd7-4874-9a9d-c0115d046be0 req-c7e7fe41-bb63-4a8f-a904-aa2b2e88c07a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055108 Aug 01 14:11:31.727636 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 147/300] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:32.449366 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-11a73caa-c8ad-4b07-b996-64b452a242d1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:32.449983 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-11a73caa-c8ad-4b07-b996-64b452a242d1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:32.454797 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:32.459021 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-11a73caa-c8ad-4b07-b996-64b452a242d1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.459409 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-14c210fc-84b5-422b-8c71-d3b1beef0168 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:32.459903 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-11a73caa-c8ad-4b07-b996-64b452a242d1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.460519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-11a73caa-c8ad-4b07-b996-64b452a242d1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.461071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-14c210fc-84b5-422b-8c71-d3b1beef0168 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:32.461274 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-11a73caa-c8ad-4b07-b996-64b452a242d1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.468263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-14c210fc-84b5-422b-8c71-d3b1beef0168 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.468893 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-14c210fc-84b5-422b-8c71-d3b1beef0168 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.469765 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-14c210fc-84b5-422b-8c71-d3b1beef0168 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.470196 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-14c210fc-84b5-422b-8c71-d3b1beef0168 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.688333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-11a73caa-c8ad-4b07-b996-64b452a242d1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:32.697119 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-11a73caa-c8ad-4b07-b996-64b452a242d1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.252439 Aug 01 14:11:32.697962 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 154/301] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:32 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:32.711604 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-14c210fc-84b5-422b-8c71-d3b1beef0168 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:32.719735 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-14c210fc-84b5-422b-8c71-d3b1beef0168 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.265935 Aug 01 14:11:32.720350 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 148/302] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:32 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:32.739677 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-90102091-999e-44f2-abd6-f78f8d0ac168 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:32.740302 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-90102091-999e-44f2-abd6-f78f8d0ac168 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:32.746885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90102091-999e-44f2-abd6-f78f8d0ac168 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.747323 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90102091-999e-44f2-abd6-f78f8d0ac168 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.748108 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90102091-999e-44f2-abd6-f78f8d0ac168 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.748574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90102091-999e-44f2-abd6-f78f8d0ac168 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.820421 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-90102091-999e-44f2-abd6-f78f8d0ac168 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:32.828369 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-90102091-999e-44f2-abd6-f78f8d0ac168 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1298 microversion: 2.1 time: 0.093085 Aug 01 14:11:32.828957 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 155/303] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:32 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:33.720618 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9af85cf4-1773-4262-98d9-d3889af1afae tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:33.721845 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-9af85cf4-1773-4262-98d9-d3889af1afae tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:33.724622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:33.734302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9af85cf4-1773-4262-98d9-d3889af1afae tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:33.734897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9af85cf4-1773-4262-98d9-d3889af1afae tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:33.736068 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9af85cf4-1773-4262-98d9-d3889af1afae tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:33.736885 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9af85cf4-1773-4262-98d9-d3889af1afae tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:33.745663 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b6ee5b74-631a-4f16-952b-a08018786a45 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:33.746355 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b6ee5b74-631a-4f16-952b-a08018786a45 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:33.758608 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b6ee5b74-631a-4f16-952b-a08018786a45 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:33.759157 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b6ee5b74-631a-4f16-952b-a08018786a45 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:33.760205 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b6ee5b74-631a-4f16-952b-a08018786a45 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:33.760715 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b6ee5b74-631a-4f16-952b-a08018786a45 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:33.975735 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9af85cf4-1773-4262-98d9-d3889af1afae tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:33.989360 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9af85cf4-1773-4262-98d9-d3889af1afae tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.272672 Aug 01 14:11:33.997615 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 149/304] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:33 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:33.999085 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b6ee5b74-631a-4f16-952b-a08018786a45 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:33.999289 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:34.000170 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:34.008107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b6ee5b74-631a-4f16-952b-a08018786a45 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.267800 Aug 01 14:11:34.008477 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:34.008965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:34.009150 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 156/305] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:33 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:34.010287 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:34.010757 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:34.046690 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:34.047123 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:34.047794 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lazy-loading 'fault' on Instance uuid 11762d81-47fb-42e8-9d2b-4e48b1019eb1 {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:11:34.107360 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:34.119388 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5f54d2e0-9496-4bc8-8be5-d81ec2927a4a tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 200 len: 1303 microversion: 2.1 time: 0.124846 Aug 01 14:11:34.119876 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 150/306] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:33 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:35.015950 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2b22dc08-5304-4a64-905a-ec4aebcad049 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:35.020418 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2b22dc08-5304-4a64-905a-ec4aebcad049 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:35.027804 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b22dc08-5304-4a64-905a-ec4aebcad049 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:35.028722 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b22dc08-5304-4a64-905a-ec4aebcad049 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:35.030062 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b22dc08-5304-4a64-905a-ec4aebcad049 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:35.035444 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b22dc08-5304-4a64-905a-ec4aebcad049 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:35.042345 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5e36451f-842f-4722-b933-43b834f41372 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:35.043787 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5e36451f-842f-4722-b933-43b834f41372 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:35.056878 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e36451f-842f-4722-b933-43b834f41372 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:35.057861 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e36451f-842f-4722-b933-43b834f41372 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:35.059669 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e36451f-842f-4722-b933-43b834f41372 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:35.060974 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e36451f-842f-4722-b933-43b834f41372 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:35.277935 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2b22dc08-5304-4a64-905a-ec4aebcad049 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:35.283644 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2b22dc08-5304-4a64-905a-ec4aebcad049 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.274407 Aug 01 14:11:35.284614 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 157/307] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:35 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:35.289684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:35.290311 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: 11762d81-47fb-42e8-9d2b-4e48b1019eb1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:35.297591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:35.298123 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:35.299158 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:35.300102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:35.301820 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5e36451f-842f-4722-b933-43b834f41372 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:35.317423 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5e36451f-842f-4722-b933-43b834f41372 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.280278 Aug 01 14:11:35.317423 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 151/308] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:35 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:35.322763 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] HTTP exception thrown: Instance 11762d81-47fb-42e8-9d2b-4e48b1019eb1 could not be found. Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Request method failure captured: Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 HTTP/1.1 Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi597b_z_WQ8WktuJVYXse3tNv6mkGl-081mmMzjPGYkn8OqRdpf8y584kw2pTqojPKdVvFnZSlptN0HbQiKmufRxl5kA6Bn60W946bQHwgAkc04Owd3EYeQMu0xFtGPda-OQZo0wrPfXSMvLfFknysfUJnxT3blPElKb4kk0TTsvAHUI Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 803bbc59642547fb932be578cb70ac3f Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesActionsTest-915804991 Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:11:35.324811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_803bbc59642547fb932be578cb70ac3f", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/803bbc59642547fb932be578cb70ac3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/803bbc59642547fb932be578cb70ac3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/803bbc59642547fb932be578cb70ac3f"}]}] Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesActionsTest-915804991 Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 803bbc59642547fb932be578cb70ac3f Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesActionsTest-915804991 Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesActionsTest-915804991-project Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 824b6455aab74659a9fb1e5e8f7c2965 Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesActionsTest-915804991-project Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 11762d81-47fb-42e8-9d2b-4e48b1019eb1 could not be found. Aug 01 14:11:35.327316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '11762d81-47fb-42e8-9d2b-4e48b1019eb1'} Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11762d81-47fb-42e8-9d2b-4e48b1019eb1 could not be found. Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:11:35.328464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11762d81-47fb-42e8-9d2b-4e48b1019eb1 could not be found. Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11762d81-47fb-42e8-9d2b-4e48b1019eb1 could not be found. Aug 01 14:11:35.330954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:11:35.332227 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Returning 404 to user: Instance 11762d81-47fb-42e8-9d2b-4e48b1019eb1 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:11:35.332227 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d2014b10-8890-4d13-b888-43d0ad3b2e87 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1" status: 404 len: 111 microversion: 2.1 time: 0.042550 Aug 01 14:11:35.332227 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 158/309] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:35 2022] GET /compute/v2.1/servers/11762d81-47fb-42e8-9d2b-4e48b1019eb1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:11:35.462483 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1339434201", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "networks": [{"uuid": "c4cb3d68-e398-4275-a8a5-8ceae3ba3e0b"}]}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:36.316664 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d8978538-0eaa-4dec-b43a-ab57682ed37a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:36.317951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d8978538-0eaa-4dec-b43a-ab57682ed37a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:36.330741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d8978538-0eaa-4dec-b43a-ab57682ed37a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:36.331514 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d8978538-0eaa-4dec-b43a-ab57682ed37a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:36.333816 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d8978538-0eaa-4dec-b43a-ab57682ed37a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:36.333816 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d8978538-0eaa-4dec-b43a-ab57682ed37a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:36.544449 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d8978538-0eaa-4dec-b43a-ab57682ed37a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:36.555720 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d8978538-0eaa-4dec-b43a-ab57682ed37a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.246222 Aug 01 14:11:36.556767 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 159/310] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:36 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:36.566164 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8236e890-7390-4d7f-966c-c81e6e904dc0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:36.570473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8236e890-7390-4d7f-966c-c81e6e904dc0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:36.582292 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8236e890-7390-4d7f-966c-c81e6e904dc0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:36.582432 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8236e890-7390-4d7f-966c-c81e6e904dc0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:36.583625 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8236e890-7390-4d7f-966c-c81e6e904dc0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:36.584409 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8236e890-7390-4d7f-966c-c81e6e904dc0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:36.754834 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8236e890-7390-4d7f-966c-c81e6e904dc0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:36.769722 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8236e890-7390-4d7f-966c-c81e6e904dc0 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.211053 Aug 01 14:11:36.770390 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 160/311] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:36 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:37.010788 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] validate_networks() for [('c4cb3d68-e398-4275-a8a5-8ceae3ba3e0b', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:11:37.099975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-9eb70334-c962-49b8-9f16-333a6ca599db req-bcb65c4c-136c-485c-8746-8a91b8bfffd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dd2869-e1f8-4607-8fc8-63858730bcc3", "name": "network-vif-plugged", "status": "completed", "tag": "1bf0befb-0ac8-4221-a091-92283e46d506"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:37.119216 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-9eb70334-c962-49b8-9f16-333a6ca599db req-bcb65c4c-136c-485c-8746-8a91b8bfffd7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.119923 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-9eb70334-c962-49b8-9f16-333a6ca599db req-bcb65c4c-136c-485c-8746-8a91b8bfffd7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.140105 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-9eb70334-c962-49b8-9f16-333a6ca599db req-bcb65c4c-136c-485c-8746-8a91b8bfffd7 service nova] Creating event network-vif-plugged:1bf0befb-0ac8-4221-a091-92283e46d506 for instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 on hv-cinder-84517 Aug 01 14:11:37.147586 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-9eb70334-c962-49b8-9f16-333a6ca599db req-bcb65c4c-136c-485c-8746-8a91b8bfffd7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053265 Aug 01 14:11:37.148546 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 161/312] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:37.592630 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8caadba4-559b-49a8-93a8-26dc70caa62c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:37.593585 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8caadba4-559b-49a8-93a8-26dc70caa62c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:37.600616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8caadba4-559b-49a8-93a8-26dc70caa62c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.601372 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8caadba4-559b-49a8-93a8-26dc70caa62c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.602390 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8caadba4-559b-49a8-93a8-26dc70caa62c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.602824 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8caadba4-559b-49a8-93a8-26dc70caa62c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.720193 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:11:37.720997 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:11:37.721559 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:11:37.723354 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:11:37.723999 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:11:37.751616 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.752418 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.753916 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.754715 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.788755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Getting quotas for project 803bbc59642547fb932be578cb70ac3f. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:37.794751 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Getting quotas for user 824b6455aab74659a9fb1e5e8f7c2965 and project 803bbc59642547fb932be578cb70ac3f. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:37.808825 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:11:37.811261 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:11:37.834557 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8caadba4-559b-49a8-93a8-26dc70caa62c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:37.848188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8caadba4-559b-49a8-93a8-26dc70caa62c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.260011 Aug 01 14:11:37.859480 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 162/313] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:37 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:37.859480 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7fb54551-c71c-488f-9b61-bd75397f5376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:37.859480 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7fb54551-c71c-488f-9b61-bd75397f5376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:37.866649 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7fb54551-c71c-488f-9b61-bd75397f5376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.867123 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7fb54551-c71c-488f-9b61-bd75397f5376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.868192 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7fb54551-c71c-488f-9b61-bd75397f5376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.868724 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7fb54551-c71c-488f-9b61-bd75397f5376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.883423 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a668b8c8-bb3f-45a0-9f00-48f93950d036 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.424281 Aug 01 14:11:37.885038 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 152/314] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:11:37.902341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b293e176-fe4f-4a25-bece-a20fb861ad54 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:37.903453 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b293e176-fe4f-4a25-bece-a20fb861ad54 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:38.008635 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b293e176-fe4f-4a25-bece-a20fb861ad54 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:38.023284 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b293e176-fe4f-4a25-bece-a20fb861ad54 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1214 microversion: 2.1 time: 0.129263 Aug 01 14:11:38.024594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 153/315] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:37 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:38.118758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7fb54551-c71c-488f-9b61-bd75397f5376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:38.132747 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7fb54551-c71c-488f-9b61-bd75397f5376 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.280796 Aug 01 14:11:38.134079 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 163/316] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:37 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:38.884637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-06bd3abf-7aa1-4a04-b006-aa1d7c43ac3e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:38.885297 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-06bd3abf-7aa1-4a04-b006-aa1d7c43ac3e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:38.893438 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-06bd3abf-7aa1-4a04-b006-aa1d7c43ac3e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:38.894258 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-06bd3abf-7aa1-4a04-b006-aa1d7c43ac3e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:38.895251 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-06bd3abf-7aa1-4a04-b006-aa1d7c43ac3e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:38.895981 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-06bd3abf-7aa1-4a04-b006-aa1d7c43ac3e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:39.055337 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-702bfb56-3cd6-43a7-8813-fc19d42b5788 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:39.059176 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-702bfb56-3cd6-43a7-8813-fc19d42b5788 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:39.072403 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-06bd3abf-7aa1-4a04-b006-aa1d7c43ac3e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:39.082396 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-702bfb56-3cd6-43a7-8813-fc19d42b5788 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:39.082697 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-06bd3abf-7aa1-4a04-b006-aa1d7c43ac3e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1357 microversion: 2.1 time: 0.204828 Aug 01 14:11:39.083165 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-702bfb56-3cd6-43a7-8813-fc19d42b5788 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:39.083373 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 154/317] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:38 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:39.085297 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-702bfb56-3cd6-43a7-8813-fc19d42b5788 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:39.086355 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-702bfb56-3cd6-43a7-8813-fc19d42b5788 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:39.155104 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-73f4b732-27bc-4379-8563-2fd45862987a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:39.155743 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-73f4b732-27bc-4379-8563-2fd45862987a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:39.163041 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-702bfb56-3cd6-43a7-8813-fc19d42b5788 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:39.164037 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-73f4b732-27bc-4379-8563-2fd45862987a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:39.164598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-73f4b732-27bc-4379-8563-2fd45862987a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:39.165361 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-73f4b732-27bc-4379-8563-2fd45862987a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:39.165791 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-73f4b732-27bc-4379-8563-2fd45862987a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:39.172835 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-702bfb56-3cd6-43a7-8813-fc19d42b5788 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1266 microversion: 2.1 time: 0.124391 Aug 01 14:11:39.174046 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 164/318] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:39 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:39.185205 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:39.202182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-a7a8f0eb-3031-490c-9b2a-5a1b386e1049 req-d6f08cb9-0ce3-4137-b0aa-86da19311604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69e5d2d-0483-4373-aa71-ea2305f287d3", "name": "network-vif-plugged", "status": "completed", "tag": "03542f14-88d5-4bf6-9c7d-0dcbe18589a5"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:39.218598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a7a8f0eb-3031-490c-9b2a-5a1b386e1049 req-d6f08cb9-0ce3-4137-b0aa-86da19311604 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:39.219011 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a7a8f0eb-3031-490c-9b2a-5a1b386e1049 req-d6f08cb9-0ce3-4137-b0aa-86da19311604 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:39.231745 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-a7a8f0eb-3031-490c-9b2a-5a1b386e1049 req-d6f08cb9-0ce3-4137-b0aa-86da19311604 service nova] Creating event network-vif-plugged:03542f14-88d5-4bf6-9c7d-0dcbe18589a5 for instance b69e5d2d-0483-4373-aa71-ea2305f287d3 on hv-cinder-84517 Aug 01 14:11:39.238007 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-a7a8f0eb-3031-490c-9b2a-5a1b386e1049 req-d6f08cb9-0ce3-4137-b0aa-86da19311604 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041383 Aug 01 14:11:39.238960 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 165/319] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:39.600780 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-73f4b732-27bc-4379-8563-2fd45862987a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:39.614074 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-73f4b732-27bc-4379-8563-2fd45862987a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.462796 Aug 01 14:11:39.615407 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 155/320] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:39 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:40.108396 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-05aea106-2ff0-4879-bd8f-d76d54ef8811 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:40.114142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-05aea106-2ff0-4879-bd8f-d76d54ef8811 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:40.124455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05aea106-2ff0-4879-bd8f-d76d54ef8811 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.125600 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05aea106-2ff0-4879-bd8f-d76d54ef8811 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.127244 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05aea106-2ff0-4879-bd8f-d76d54ef8811 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.128311 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05aea106-2ff0-4879-bd8f-d76d54ef8811 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.210702 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5b6de28e-c494-48aa-826e-1a78d35e968b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:40.211327 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5b6de28e-c494-48aa-826e-1a78d35e968b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:40.218942 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5b6de28e-c494-48aa-826e-1a78d35e968b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.219391 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5b6de28e-c494-48aa-826e-1a78d35e968b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.220204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5b6de28e-c494-48aa-826e-1a78d35e968b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.220671 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5b6de28e-c494-48aa-826e-1a78d35e968b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.405841 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5b6de28e-c494-48aa-826e-1a78d35e968b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:40.416170 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5b6de28e-c494-48aa-826e-1a78d35e968b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1272 microversion: 2.1 time: 0.209847 Aug 01 14:11:40.417117 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 156/321] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:40 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:40.551017 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-05aea106-2ff0-4879-bd8f-d76d54ef8811 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:40.558248 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-05aea106-2ff0-4879-bd8f-d76d54ef8811 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1546 microversion: 2.1 time: 0.454896 Aug 01 14:11:40.559194 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 166/322] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:40 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1546 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:40.580180 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8acbee34-2b8b-44a0-9572-8c041a70d8a4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:40.580855 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8acbee34-2b8b-44a0-9572-8c041a70d8a4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:40.587708 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8acbee34-2b8b-44a0-9572-8c041a70d8a4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.588155 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8acbee34-2b8b-44a0-9572-8c041a70d8a4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.588967 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8acbee34-2b8b-44a0-9572-8c041a70d8a4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.589395 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8acbee34-2b8b-44a0-9572-8c041a70d8a4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.638911 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3c0e6872-5040-44f1-ab6d-7d0e45193a79 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:40.639639 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3c0e6872-5040-44f1-ab6d-7d0e45193a79 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:40.646969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c0e6872-5040-44f1-ab6d-7d0e45193a79 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.647512 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c0e6872-5040-44f1-ab6d-7d0e45193a79 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.648569 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c0e6872-5040-44f1-ab6d-7d0e45193a79 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.649193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c0e6872-5040-44f1-ab6d-7d0e45193a79 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.903481 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8acbee34-2b8b-44a0-9572-8c041a70d8a4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:40.915999 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8acbee34-2b8b-44a0-9572-8c041a70d8a4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1546 microversion: 2.1 time: 0.339714 Aug 01 14:11:40.929106 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 157/323] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:40 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1546 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:40.937797 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0a777edd-81c0-4167-90db-1c96fba023df tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:40.947086 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3c0e6872-5040-44f1-ab6d-7d0e45193a79 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:40.957368 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0a777edd-81c0-4167-90db-1c96fba023df tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:40.959905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0a777edd-81c0-4167-90db-1c96fba023df tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Searching by: {'deleted': False, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62'} {{(pid=118110) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 14:11:40.968688 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3c0e6872-5040-44f1-ab6d-7d0e45193a79 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.333920 Aug 01 14:11:40.969460 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 167/324] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:40 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:40.973644 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0a777edd-81c0-4167-90db-1c96fba023df tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.974472 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0a777edd-81c0-4167-90db-1c96fba023df tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.975870 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0a777edd-81c0-4167-90db-1c96fba023df tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.976430 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0a777edd-81c0-4167-90db-1c96fba023df tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:41.075062 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.multi_cell_list [None req-0a777edd-81c0-4167-90db-1c96fba023df tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118110) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 14:11:41.181575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0a777edd-81c0-4167-90db-1c96fba023df tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.247496 Aug 01 14:11:41.182578 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 158/325] 10.222.0.45 () {58 vars in 1125 bytes} [Mon Aug 1 14:11:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:41.194701 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8bc46772-d1f5-42f4-900a-f7ee1efe5703 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:41.195300 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8bc46772-d1f5-42f4-900a-f7ee1efe5703 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:41.203867 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8bc46772-d1f5-42f4-900a-f7ee1efe5703 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:41.204186 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8bc46772-d1f5-42f4-900a-f7ee1efe5703 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:41.205864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8bc46772-d1f5-42f4-900a-f7ee1efe5703 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:41.205864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8bc46772-d1f5-42f4-900a-f7ee1efe5703 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:41.384539 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8bc46772-d1f5-42f4-900a-f7ee1efe5703 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:41.393008 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8bc46772-d1f5-42f4-900a-f7ee1efe5703 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1546 microversion: 2.1 time: 0.202576 Aug 01 14:11:41.393611 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 168/326] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:41 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1546 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:41.441137 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b743c80d-158e-4429-b042-fc7328653491 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:41.442024 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b743c80d-158e-4429-b042-fc7328653491 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:41.458164 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b743c80d-158e-4429-b042-fc7328653491 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:41.458963 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b743c80d-158e-4429-b042-fc7328653491 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:41.461509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b743c80d-158e-4429-b042-fc7328653491 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:41.462037 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b743c80d-158e-4429-b042-fc7328653491 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:41.720650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b743c80d-158e-4429-b042-fc7328653491 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:41.729657 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b743c80d-158e-4429-b042-fc7328653491 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1314 microversion: 2.1 time: 0.295451 Aug 01 14:11:41.743703 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 159/327] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:41 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:41.998384 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-664318a6-21a3-41eb-baaa-9f1d3902629d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:41.999515 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-664318a6-21a3-41eb-baaa-9f1d3902629d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:42.008149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-664318a6-21a3-41eb-baaa-9f1d3902629d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:42.009318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-664318a6-21a3-41eb-baaa-9f1d3902629d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:42.010352 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-664318a6-21a3-41eb-baaa-9f1d3902629d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:42.010752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-664318a6-21a3-41eb-baaa-9f1d3902629d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:42.314163 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-664318a6-21a3-41eb-baaa-9f1d3902629d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:42.319060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:42.331211 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-664318a6-21a3-41eb-baaa-9f1d3902629d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1372 microversion: 2.1 time: 0.339728 Aug 01 14:11:42.332041 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 169/328] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:41 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1372 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:42.557600 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-be4ef8db-4501-4ea4-8fa3-6f8ae6da73b4 req-7ccbf8b7-612e-44a8-9c52-3c75671e3777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d31bf2d4-54b7-42bc-b538-2482464fb82d", "tag": "d18f8bb0-46f8-41e5-b2fb-b52607439b5e"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:42.575818 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-be4ef8db-4501-4ea4-8fa3-6f8ae6da73b4 req-7ccbf8b7-612e-44a8-9c52-3c75671e3777 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:42.576632 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-be4ef8db-4501-4ea4-8fa3-6f8ae6da73b4 req-7ccbf8b7-612e-44a8-9c52-3c75671e3777 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:42.599408 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-be4ef8db-4501-4ea4-8fa3-6f8ae6da73b4 req-7ccbf8b7-612e-44a8-9c52-3c75671e3777 service nova] Creating event network-changed:d18f8bb0-46f8-41e5-b2fb-b52607439b5e for instance d31bf2d4-54b7-42bc-b538-2482464fb82d on hv-cinder-84517 Aug 01 14:11:42.608943 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-be4ef8db-4501-4ea4-8fa3-6f8ae6da73b4 req-7ccbf8b7-612e-44a8-9c52-3c75671e3777 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058489 Aug 01 14:11:42.610003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 160/329] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:42.752906 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a3816d9a-47f3-447a-9d5f-a2d71c2b6a02 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:42.756126 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a3816d9a-47f3-447a-9d5f-a2d71c2b6a02 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:42.763807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3816d9a-47f3-447a-9d5f-a2d71c2b6a02 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:42.764515 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3816d9a-47f3-447a-9d5f-a2d71c2b6a02 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:42.765618 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3816d9a-47f3-447a-9d5f-a2d71c2b6a02 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:42.766219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3816d9a-47f3-447a-9d5f-a2d71c2b6a02 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:43.253360 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a3816d9a-47f3-447a-9d5f-a2d71c2b6a02 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:43.258410 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a8295a91-e373-4fb1-b535-6599980dee06 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8db5c354-9003-45f5-8b92-695a830c4a2a"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:43.262674 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a8295a91-e373-4fb1-b535-6599980dee06 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:43.271317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a8295a91-e373-4fb1-b535-6599980dee06 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:43.271543 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a3816d9a-47f3-447a-9d5f-a2d71c2b6a02 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1314 microversion: 2.1 time: 0.523014 Aug 01 14:11:43.271787 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a8295a91-e373-4fb1-b535-6599980dee06 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:43.272806 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 170/330] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:42 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:43.275889 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a8295a91-e373-4fb1-b535-6599980dee06 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:43.277221 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a8295a91-e373-4fb1-b535-6599980dee06 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:43.361972 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-44d00ce6-c742-466e-a9f3-938bddd4c12c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:43.363750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-44d00ce6-c742-466e-a9f3-938bddd4c12c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:43.370833 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44d00ce6-c742-466e-a9f3-938bddd4c12c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:43.371662 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44d00ce6-c742-466e-a9f3-938bddd4c12c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:43.372562 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44d00ce6-c742-466e-a9f3-938bddd4c12c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:43.373084 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44d00ce6-c742-466e-a9f3-938bddd4c12c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:43.624195 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-44d00ce6-c742-466e-a9f3-938bddd4c12c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:43.634873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-44d00ce6-c742-466e-a9f3-938bddd4c12c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1566 microversion: 2.1 time: 0.276745 Aug 01 14:11:43.636445 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 171/331] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:43 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:43.638973 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a8295a91-e373-4fb1-b535-6599980dee06 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "POST /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387405 Aug 01 14:11:43.645976 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 161/332] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:11:43 2022] POST /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:43.648577 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1153823186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-923806228", "security_groups": [{"name": "tempest-secgroup-smoke-1476544160"}], "block_device_mapping_v2": [{"uuid": "54489e5d-015e-4551-8060-59610ce62d05", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e95fe17e-40dc-4b82-adc2-9adb31102a43"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:43.678578 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ac6f0696-39b2-479d-8c43-957b1ca2ebae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:43.680356 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ac6f0696-39b2-479d-8c43-957b1ca2ebae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:43.697948 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac6f0696-39b2-479d-8c43-957b1ca2ebae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:43.698675 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac6f0696-39b2-479d-8c43-957b1ca2ebae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:43.699722 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac6f0696-39b2-479d-8c43-957b1ca2ebae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:43.700534 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac6f0696-39b2-479d-8c43-957b1ca2ebae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:43.882646 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ac6f0696-39b2-479d-8c43-957b1ca2ebae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210021 Aug 01 14:11:43.883988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 162/333] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 14:11:43 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:43.926769 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] validate_networks() for [('e95fe17e-40dc-4b82-adc2-9adb31102a43', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:11:44.299842 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1cd9fd89-b1b7-47cc-8635-fdda29568fcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:44.301131 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1cd9fd89-b1b7-47cc-8635-fdda29568fcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:44.308211 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1cd9fd89-b1b7-47cc-8635-fdda29568fcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:44.309019 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1cd9fd89-b1b7-47cc-8635-fdda29568fcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:44.310011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1cd9fd89-b1b7-47cc-8635-fdda29568fcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:44.310666 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1cd9fd89-b1b7-47cc-8635-fdda29568fcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:44.651458 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1cd9fd89-b1b7-47cc-8635-fdda29568fcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:44.661488 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1cd9fd89-b1b7-47cc-8635-fdda29568fcc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1314 microversion: 2.1 time: 0.366079 Aug 01 14:11:44.662461 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 163/334] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:44 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:44.878056 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:11:44.878804 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:11:44.879726 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:11:44.880506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:11:44.881268 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:11:44.896604 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:44.897047 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:44.897860 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:44.898286 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:44.925107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Getting quotas for project f0a6c07d69ef4cf4a545f48e7079044d. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:44.932492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Getting quotas for user 8e30910692b4474092f1585a671e2f41 and project f0a6c07d69ef4cf4a545f48e7079044d. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:45.009436 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:11:45.012526 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54489e5d-015e-4551-8060-59610ce62d05',volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:11:45.225186 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-47a17616-f894-4aa5-8ca7-b10445aaa9b9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.587003 Aug 01 14:11:45.232116 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 172/335] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:11:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:11:45.238521 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c0a58515-fcc1-40d4-bc38-8669d1cdb50a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:45.239693 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c0a58515-fcc1-40d4-bc38-8669d1cdb50a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:45.319450 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c0a58515-fcc1-40d4-bc38-8669d1cdb50a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:45.326890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c0a58515-fcc1-40d4-bc38-8669d1cdb50a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1094 microversion: 2.1 time: 0.092833 Aug 01 14:11:45.327605 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 164/336] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:45 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:45.491533 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-3eae4691-6863-4243-b6ec-1ec8f7cb94fc req-fce62271-667f-4a18-affd-60f0c7b14b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69e5d2d-0483-4373-aa71-ea2305f287d3", "tag": "03542f14-88d5-4bf6-9c7d-0dcbe18589a5"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:45.513656 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-3eae4691-6863-4243-b6ec-1ec8f7cb94fc req-fce62271-667f-4a18-affd-60f0c7b14b4e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:45.514400 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-3eae4691-6863-4243-b6ec-1ec8f7cb94fc req-fce62271-667f-4a18-affd-60f0c7b14b4e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:45.538796 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-3eae4691-6863-4243-b6ec-1ec8f7cb94fc req-fce62271-667f-4a18-affd-60f0c7b14b4e service nova] Creating event network-changed:03542f14-88d5-4bf6-9c7d-0dcbe18589a5 for instance b69e5d2d-0483-4373-aa71-ea2305f287d3 on hv-cinder-84517 Aug 01 14:11:45.549080 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-3eae4691-6863-4243-b6ec-1ec8f7cb94fc req-fce62271-667f-4a18-affd-60f0c7b14b4e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063686 Aug 01 14:11:45.550742 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 173/337] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:45.699447 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f747fc96-34be-4897-a38e-2349051c07f0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:45.701036 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f747fc96-34be-4897-a38e-2349051c07f0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:45.712832 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f747fc96-34be-4897-a38e-2349051c07f0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:45.713814 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f747fc96-34be-4897-a38e-2349051c07f0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:45.715253 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f747fc96-34be-4897-a38e-2349051c07f0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:45.716037 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f747fc96-34be-4897-a38e-2349051c07f0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:45.924690 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f747fc96-34be-4897-a38e-2349051c07f0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:45.940001 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f747fc96-34be-4897-a38e-2349051c07f0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1314 microversion: 2.1 time: 0.248181 Aug 01 14:11:45.944095 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 165/338] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:45 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:46.353788 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c10dd6ea-1183-4280-b7b8-f7b5f2410b28 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:46.355056 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c10dd6ea-1183-4280-b7b8-f7b5f2410b28 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:46.364149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c10dd6ea-1183-4280-b7b8-f7b5f2410b28 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:46.365002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c10dd6ea-1183-4280-b7b8-f7b5f2410b28 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:46.365911 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c10dd6ea-1183-4280-b7b8-f7b5f2410b28 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:46.366350 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c10dd6ea-1183-4280-b7b8-f7b5f2410b28 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:46.456380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c10dd6ea-1183-4280-b7b8-f7b5f2410b28 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:46.465908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c10dd6ea-1183-4280-b7b8-f7b5f2410b28 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1192 microversion: 2.1 time: 0.121119 Aug 01 14:11:46.466643 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 174/339] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:46 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:46.975198 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-79257f5d-a09a-40f2-8122-42db8d3015b0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:46.975819 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-79257f5d-a09a-40f2-8122-42db8d3015b0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:46.996071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-79257f5d-a09a-40f2-8122-42db8d3015b0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:46.996570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-79257f5d-a09a-40f2-8122-42db8d3015b0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:46.997354 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-79257f5d-a09a-40f2-8122-42db8d3015b0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:46.997784 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-79257f5d-a09a-40f2-8122-42db8d3015b0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:47.369297 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-79257f5d-a09a-40f2-8122-42db8d3015b0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:47.379748 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-79257f5d-a09a-40f2-8122-42db8d3015b0 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1314 microversion: 2.1 time: 0.409017 Aug 01 14:11:47.380701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 166/340] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:46 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:47.489828 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bc8a657e-1336-4403-9ee1-743a9675be81 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:47.490448 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bc8a657e-1336-4403-9ee1-743a9675be81 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:47.499634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bc8a657e-1336-4403-9ee1-743a9675be81 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:47.500437 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bc8a657e-1336-4403-9ee1-743a9675be81 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:47.501404 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bc8a657e-1336-4403-9ee1-743a9675be81 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:47.501857 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bc8a657e-1336-4403-9ee1-743a9675be81 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:47.590634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bc8a657e-1336-4403-9ee1-743a9675be81 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:47.615454 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bc8a657e-1336-4403-9ee1-743a9675be81 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1210 microversion: 2.1 time: 0.125161 Aug 01 14:11:47.615454 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 175/341] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:47 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:47.988919 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-577625f1-baf7-440d-982b-a85d9c19ff97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:47.990757 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-577625f1-baf7-440d-982b-a85d9c19ff97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:48.002166 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-577625f1-baf7-440d-982b-a85d9c19ff97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:48.002996 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-577625f1-baf7-440d-982b-a85d9c19ff97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:48.004963 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-577625f1-baf7-440d-982b-a85d9c19ff97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:48.005583 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-577625f1-baf7-440d-982b-a85d9c19ff97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:48.210213 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-577625f1-baf7-440d-982b-a85d9c19ff97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lazy-loading 'services' on Instance uuid 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:11:48.376860 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-577625f1-baf7-440d-982b-a85d9c19ff97 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/os-volume_attachments/ee8ef593-d0b1-4e89-a909-141739bfa0c8" status: 202 len: 0 microversion: 2.1 time: 0.394114 Aug 01 14:11:48.378414 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 167/342] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:11:47 2022] DELETE /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/os-volume_attachments/ee8ef593-d0b1-4e89-a909-141739bfa0c8 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:11:48.430794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dbd6c9a3-ed5b-416e-80c7-d77d6cfdecc9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:48.432330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dbd6c9a3-ed5b-416e-80c7-d77d6cfdecc9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:48.445807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dbd6c9a3-ed5b-416e-80c7-d77d6cfdecc9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:48.446283 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dbd6c9a3-ed5b-416e-80c7-d77d6cfdecc9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:48.447105 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dbd6c9a3-ed5b-416e-80c7-d77d6cfdecc9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:48.447783 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dbd6c9a3-ed5b-416e-80c7-d77d6cfdecc9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:48.647531 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3139f022-b708-4f39-89f3-2e540ed2a479 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:48.648563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3139f022-b708-4f39-89f3-2e540ed2a479 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:48.656031 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3139f022-b708-4f39-89f3-2e540ed2a479 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:48.656594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3139f022-b708-4f39-89f3-2e540ed2a479 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:48.657826 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3139f022-b708-4f39-89f3-2e540ed2a479 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:48.658612 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3139f022-b708-4f39-89f3-2e540ed2a479 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:48.713193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dbd6c9a3-ed5b-416e-80c7-d77d6cfdecc9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:48.721007 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dbd6c9a3-ed5b-416e-80c7-d77d6cfdecc9 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1314 microversion: 2.1 time: 0.309651 Aug 01 14:11:48.721803 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 176/343] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:48 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:48.877627 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3139f022-b708-4f39-89f3-2e540ed2a479 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:48.888345 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3139f022-b708-4f39-89f3-2e540ed2a479 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1278 microversion: 2.1 time: 0.246273 Aug 01 14:11:48.889060 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 168/344] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:48 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:48.972507 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-e23aca4c-f25a-44a9-9c40-65d3e814d97c req-9e6ceab1-afa9-4a37-93e9-4bafe1d91528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7f31f9-adc0-4be6-92b9-0c2c99e14308", "tag": "754c5fad-2162-4018-96e9-5a8df36d546e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:49.009586 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e23aca4c-f25a-44a9-9c40-65d3e814d97c req-9e6ceab1-afa9-4a37-93e9-4bafe1d91528 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:49.010237 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e23aca4c-f25a-44a9-9c40-65d3e814d97c req-9e6ceab1-afa9-4a37-93e9-4bafe1d91528 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:49.039023 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-e23aca4c-f25a-44a9-9c40-65d3e814d97c req-9e6ceab1-afa9-4a37-93e9-4bafe1d91528 service nova] Creating event network-changed:754c5fad-2162-4018-96e9-5a8df36d546e for instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 on hv-cinder-84517 Aug 01 14:11:49.046450 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-e23aca4c-f25a-44a9-9c40-65d3e814d97c req-9e6ceab1-afa9-4a37-93e9-4bafe1d91528 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087024 Aug 01 14:11:49.047247 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 177/345] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:49.457161 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1175805945", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-875785955", "security_groups": [{"name": "tempest-secgroup-smoke-1280187605"}], "networks": [{"uuid": "83622244-0e2b-48fa-9f1f-b69b203342d9"}], "block_device_mapping_v2": [{"uuid": "cae19270-7f4a-4916-a0d2-84d1838b1ca1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:49.668298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] validate_networks() for [('83622244-0e2b-48fa-9f1f-b69b203342d9', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:11:49.748003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dc8a9f62-6a9a-430a-bf94-27ab2e341c12 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:49.748815 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dc8a9f62-6a9a-430a-bf94-27ab2e341c12 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:49.755890 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc8a9f62-6a9a-430a-bf94-27ab2e341c12 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:49.756374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc8a9f62-6a9a-430a-bf94-27ab2e341c12 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:49.757170 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc8a9f62-6a9a-430a-bf94-27ab2e341c12 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:49.757591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc8a9f62-6a9a-430a-bf94-27ab2e341c12 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:50.082054 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dc8a9f62-6a9a-430a-bf94-27ab2e341c12 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:50.090213 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dc8a9f62-6a9a-430a-bf94-27ab2e341c12 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1314 microversion: 2.1 time: 0.348617 Aug 01 14:11:50.090734 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 178/346] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:49 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:50.095526 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7f49afb6-9d72-4a96-9c35-fbc931c02a1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:50.096167 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7f49afb6-9d72-4a96-9c35-fbc931c02a1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:50.102702 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7f49afb6-9d72-4a96-9c35-fbc931c02a1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:50.103156 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7f49afb6-9d72-4a96-9c35-fbc931c02a1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:50.103938 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7f49afb6-9d72-4a96-9c35-fbc931c02a1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:50.104426 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7f49afb6-9d72-4a96-9c35-fbc931c02a1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:50.581531 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:11:50.582151 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:11:50.583502 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:11:50.584091 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:11:50.584638 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:11:50.600080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:50.600700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:50.601575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:50.602148 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:50.614549 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7f49afb6-9d72-4a96-9c35-fbc931c02a1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:50.627317 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7f49afb6-9d72-4a96-9c35-fbc931c02a1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1278 microversion: 2.1 time: 0.535429 Aug 01 14:11:50.627954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 179/347] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:50 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1278 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:50.631984 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Getting quotas for project 6bfbca571c4b4199a577322e866dfae9. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:50.637306 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Getting quotas for user b4ae8decd5354231bebc7bfda44d3285 and project 6bfbca571c4b4199a577322e866dfae9. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:50.703383 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:11:50.705491 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cae19270-7f4a-4916-a0d2-84d1838b1ca1',volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:11:50.896039 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-324bbade-4854-4870-acc3-8d13dec666c2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.442838 Aug 01 14:11:50.905822 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 169/348] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:11:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:11:50.913107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bd4ed193-12bb-4b22-ad32-b5d9ced80cfd tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:50.914506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bd4ed193-12bb-4b22-ad32-b5d9ced80cfd tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:51.046330 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-b756763a-6dd9-4f59-8fbb-03b1904b2fe7 req-5397fc67-190e-4d40-a085-aea0a04fd952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d31bf2d4-54b7-42bc-b538-2482464fb82d", "name": "network-vif-plugged", "status": "completed", "tag": "d18f8bb0-46f8-41e5-b2fb-b52607439b5e"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:51.059127 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-b756763a-6dd9-4f59-8fbb-03b1904b2fe7 req-5397fc67-190e-4d40-a085-aea0a04fd952 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.059514 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-b756763a-6dd9-4f59-8fbb-03b1904b2fe7 req-5397fc67-190e-4d40-a085-aea0a04fd952 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.073935 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-b756763a-6dd9-4f59-8fbb-03b1904b2fe7 req-5397fc67-190e-4d40-a085-aea0a04fd952 service nova] Creating event network-vif-plugged:d18f8bb0-46f8-41e5-b2fb-b52607439b5e for instance d31bf2d4-54b7-42bc-b538-2482464fb82d on hv-cinder-84517 Aug 01 14:11:51.079379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-b756763a-6dd9-4f59-8fbb-03b1904b2fe7 req-5397fc67-190e-4d40-a085-aea0a04fd952 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037474 Aug 01 14:11:51.079987 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 170/349] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:51.081941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bd4ed193-12bb-4b22-ad32-b5d9ced80cfd tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:51.091995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bd4ed193-12bb-4b22-ad32-b5d9ced80cfd tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1088 microversion: 2.1 time: 0.183597 Aug 01 14:11:51.104773 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 180/350] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:50 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1088 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:51.114865 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8756f698-5288-42f7-ab65-0b86f0d65018 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:51.116854 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8756f698-5288-42f7-ab65-0b86f0d65018 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:51.125375 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8756f698-5288-42f7-ab65-0b86f0d65018 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.126441 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8756f698-5288-42f7-ab65-0b86f0d65018 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.127682 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8756f698-5288-42f7-ab65-0b86f0d65018 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.128385 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8756f698-5288-42f7-ab65-0b86f0d65018 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.229795 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-04eb72d7-d3b9-4abf-a613-8a68aecd0bbb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:51.230791 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-04eb72d7-d3b9-4abf-a613-8a68aecd0bbb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:51.252062 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04eb72d7-d3b9-4abf-a613-8a68aecd0bbb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.254942 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04eb72d7-d3b9-4abf-a613-8a68aecd0bbb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.257208 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04eb72d7-d3b9-4abf-a613-8a68aecd0bbb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.259049 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04eb72d7-d3b9-4abf-a613-8a68aecd0bbb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.302492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-04eb72d7-d3b9-4abf-a613-8a68aecd0bbb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/ips" status: 200 len: 152 microversion: 2.20 time: 0.088186 Aug 01 14:11:51.303525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 181/351] 10.222.0.45 () {60 vars in 1289 bytes} [Mon Aug 1 14:11:51 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/ips => generated 152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:11:51.472231 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8756f698-5288-42f7-ab65-0b86f0d65018 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:51.486840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8756f698-5288-42f7-ab65-0b86f0d65018 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1314 microversion: 2.1 time: 0.376687 Aug 01 14:11:51.504499 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 171/352] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:51 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:51.651677 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-99ee4d7a-f279-4779-8c38-37150b50c91c tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:51.653168 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-99ee4d7a-f279-4779-8c38-37150b50c91c tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:51.664969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-99ee4d7a-f279-4779-8c38-37150b50c91c tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.665623 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-99ee4d7a-f279-4779-8c38-37150b50c91c tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.666484 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-99ee4d7a-f279-4779-8c38-37150b50c91c tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.667187 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-99ee4d7a-f279-4779-8c38-37150b50c91c tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.885309 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0d65d2a1-0040-4137-930c-9c3d1b3aa368 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:51.886509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0d65d2a1-0040-4137-930c-9c3d1b3aa368 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:51.898193 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d65d2a1-0040-4137-930c-9c3d1b3aa368 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.898990 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d65d2a1-0040-4137-930c-9c3d1b3aa368 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.900221 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d65d2a1-0040-4137-930c-9c3d1b3aa368 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.901045 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d65d2a1-0040-4137-930c-9c3d1b3aa368 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.908918 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-99ee4d7a-f279-4779-8c38-37150b50c91c tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:51.920005 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-99ee4d7a-f279-4779-8c38-37150b50c91c tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1278 microversion: 2.1 time: 0.274356 Aug 01 14:11:51.921715 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 182/353] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:51 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:52.108532 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0d65d2a1-0040-4137-930c-9c3d1b3aa368 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:52.118865 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0d65d2a1-0040-4137-930c-9c3d1b3aa368 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1592 microversion: 2.1 time: 0.243074 Aug 01 14:11:52.119997 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 172/354] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:51 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1592 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:52.121029 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-25ce3adc-b501-4116-94f6-363e346c5377 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:52.123205 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-25ce3adc-b501-4116-94f6-363e346c5377 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:52.131964 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25ce3adc-b501-4116-94f6-363e346c5377 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:52.132580 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25ce3adc-b501-4116-94f6-363e346c5377 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:52.133840 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25ce3adc-b501-4116-94f6-363e346c5377 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:52.134598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25ce3adc-b501-4116-94f6-363e346c5377 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:52.219996 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-25ce3adc-b501-4116-94f6-363e346c5377 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:52.234997 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-25ce3adc-b501-4116-94f6-363e346c5377 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1138 microversion: 2.1 time: 0.118756 Aug 01 14:11:52.236044 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 183/355] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:52 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1138 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:52.521843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2ba63f45-5bc8-4076-a386-eb2c4f13f37b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:52.522455 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2ba63f45-5bc8-4076-a386-eb2c4f13f37b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:52.529730 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ba63f45-5bc8-4076-a386-eb2c4f13f37b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:52.530137 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ba63f45-5bc8-4076-a386-eb2c4f13f37b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:52.530911 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ba63f45-5bc8-4076-a386-eb2c4f13f37b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:52.531341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ba63f45-5bc8-4076-a386-eb2c4f13f37b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:52.536492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:52.768891 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2ba63f45-5bc8-4076-a386-eb2c4f13f37b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:52.779418 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2ba63f45-5bc8-4076-a386-eb2c4f13f37b tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1314 microversion: 2.1 time: 0.261594 Aug 01 14:11:52.780023 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 173/356] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:52 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:52.951499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0e1679be-bc97-46fd-9f9c-bc0f31e2da0a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:52.952534 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0e1679be-bc97-46fd-9f9c-bc0f31e2da0a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:52.962289 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0e1679be-bc97-46fd-9f9c-bc0f31e2da0a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:52.963072 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0e1679be-bc97-46fd-9f9c-bc0f31e2da0a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:52.964122 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0e1679be-bc97-46fd-9f9c-bc0f31e2da0a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:52.964917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0e1679be-bc97-46fd-9f9c-bc0f31e2da0a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:53.229087 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0e1679be-bc97-46fd-9f9c-bc0f31e2da0a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:53.239993 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0e1679be-bc97-46fd-9f9c-bc0f31e2da0a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.292264 Aug 01 14:11:53.246158 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 184/357] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:52 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:53.278260 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2976a878-d794-4a1c-af12-1531ad91dc9b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:53.279460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2976a878-d794-4a1c-af12-1531ad91dc9b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:53.290780 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2976a878-d794-4a1c-af12-1531ad91dc9b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:53.291554 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2976a878-d794-4a1c-af12-1531ad91dc9b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:53.293323 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2976a878-d794-4a1c-af12-1531ad91dc9b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:53.294419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2976a878-d794-4a1c-af12-1531ad91dc9b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:53.406640 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2976a878-d794-4a1c-af12-1531ad91dc9b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:53.416296 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2976a878-d794-4a1c-af12-1531ad91dc9b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1130 microversion: 2.1 time: 0.148182 Aug 01 14:11:53.416899 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 174/358] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:53 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1130 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:53.803602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-07828bb5-8b10-4749-80d1-143e950f6f98 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:53.804333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-07828bb5-8b10-4749-80d1-143e950f6f98 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:53.811725 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07828bb5-8b10-4749-80d1-143e950f6f98 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:53.813611 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07828bb5-8b10-4749-80d1-143e950f6f98 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:53.813611 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07828bb5-8b10-4749-80d1-143e950f6f98 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:53.813611 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07828bb5-8b10-4749-80d1-143e950f6f98 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.056619 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-07828bb5-8b10-4749-80d1-143e950f6f98 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:54.064523 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-07828bb5-8b10-4749-80d1-143e950f6f98 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1499 microversion: 2.1 time: 0.265131 Aug 01 14:11:54.065105 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 185/359] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:53 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1499 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:54.268263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8ee2ba14-7fb5-4de7-b5d9-d53e2a2c50ba tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:54.268895 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8ee2ba14-7fb5-4de7-b5d9-d53e2a2c50ba tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:54.279477 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8ee2ba14-7fb5-4de7-b5d9-d53e2a2c50ba tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:54.280889 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8ee2ba14-7fb5-4de7-b5d9-d53e2a2c50ba tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.281829 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8ee2ba14-7fb5-4de7-b5d9-d53e2a2c50ba tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:54.286600 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8ee2ba14-7fb5-4de7-b5d9-d53e2a2c50ba tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.452471 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6a2dfcae-935e-486d-96b8-22a8dc055c9f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:54.453499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6a2dfcae-935e-486d-96b8-22a8dc055c9f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:54.468968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a2dfcae-935e-486d-96b8-22a8dc055c9f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:54.469959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a2dfcae-935e-486d-96b8-22a8dc055c9f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.471419 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a2dfcae-935e-486d-96b8-22a8dc055c9f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:54.472493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a2dfcae-935e-486d-96b8-22a8dc055c9f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.625258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6a2dfcae-935e-486d-96b8-22a8dc055c9f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:54.644352 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6a2dfcae-935e-486d-96b8-22a8dc055c9f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1194 microversion: 2.1 time: 0.208316 Aug 01 14:11:54.664708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 186/360] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:54 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1194 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:54.805479 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ac1a97d9-fc20-4b83-a940-fede42353b0f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:54.806310 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ac1a97d9-fc20-4b83-a940-fede42353b0f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:54.816845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ac1a97d9-fc20-4b83-a940-fede42353b0f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:54.817654 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ac1a97d9-fc20-4b83-a940-fede42353b0f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.827440 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ac1a97d9-fc20-4b83-a940-fede42353b0f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:54.827857 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ac1a97d9-fc20-4b83-a940-fede42353b0f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.855407 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8ee2ba14-7fb5-4de7-b5d9-d53e2a2c50ba tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:54.857229 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ac1a97d9-fc20-4b83-a940-fede42353b0f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:11:54.867966 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8ee2ba14-7fb5-4de7-b5d9-d53e2a2c50ba tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.603285 Aug 01 14:11:54.869396 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 175/361] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:54 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:54.883057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-4024657c-e1a7-441b-8152-96a36fedf93a req-413323a0-b671-4437-bd36-9fc97f78f9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dd2869-e1f8-4607-8fc8-63858730bcc3", "tag": "1bf0befb-0ac8-4221-a091-92283e46d506"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:54.897654 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-4024657c-e1a7-441b-8152-96a36fedf93a req-413323a0-b671-4437-bd36-9fc97f78f9d0 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:54.898376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-4024657c-e1a7-441b-8152-96a36fedf93a req-413323a0-b671-4437-bd36-9fc97f78f9d0 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.907251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:54.921848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-4024657c-e1a7-441b-8152-96a36fedf93a req-413323a0-b671-4437-bd36-9fc97f78f9d0 service nova] Creating event network-changed:1bf0befb-0ac8-4221-a091-92283e46d506 for instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 on hv-cinder-84517 Aug 01 14:11:54.935123 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-4024657c-e1a7-441b-8152-96a36fedf93a req-413323a0-b671-4437-bd36-9fc97f78f9d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058214 Aug 01 14:11:54.938898 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 176/362] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:55.062008 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a16481b1-d755-4e19-af9a-ffe7d8473fb1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:55.069578 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a16481b1-d755-4e19-af9a-ffe7d8473fb1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:55.070037 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a16481b1-d755-4e19-af9a-ffe7d8473fb1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:55.071053 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ac1a97d9-fc20-4b83-a940-fede42353b0f tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 204 len: 0 microversion: 2.1 time: 0.268015 Aug 01 14:11:55.071712 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 187/363] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:11:54 2022] DELETE /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:11:55.087392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-64f6d232-811c-420c-9400-b01e358ca8bc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:55.089024 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-64f6d232-811c-420c-9400-b01e358ca8bc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:55.105147 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64f6d232-811c-420c-9400-b01e358ca8bc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:55.106001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64f6d232-811c-420c-9400-b01e358ca8bc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:55.107995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64f6d232-811c-420c-9400-b01e358ca8bc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:55.108571 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-64f6d232-811c-420c-9400-b01e358ca8bc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:55.118918 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:55.121127 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a16481b1-d755-4e19-af9a-ffe7d8473fb1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Going to try to stop instance {{(pid=118110) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 14:11:55.232744 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a16481b1-d755-4e19-af9a-ffe7d8473fb1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/action" status: 202 len: 0 microversion: 2.1 time: 0.167235 Aug 01 14:11:55.233531 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 177/364] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:11:55 2022] POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:11:55.246682 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c4ac7772-ee88-4276-951d-2889501178fe tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:55.247389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c4ac7772-ee88-4276-951d-2889501178fe tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:55.258450 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c4ac7772-ee88-4276-951d-2889501178fe tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:55.259041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c4ac7772-ee88-4276-951d-2889501178fe tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:55.260119 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c4ac7772-ee88-4276-951d-2889501178fe tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:55.260928 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c4ac7772-ee88-4276-951d-2889501178fe tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:55.791223 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-64f6d232-811c-420c-9400-b01e358ca8bc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:55.801002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-64f6d232-811c-420c-9400-b01e358ca8bc tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1505 microversion: 2.1 time: 0.722170 Aug 01 14:11:55.817737 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 188/365] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:55 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1505 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:55.827806 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2cb906df-cc23-4438-be86-a5cc447bfdea tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:55.828464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2cb906df-cc23-4438-be86-a5cc447bfdea tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:55.839096 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cb906df-cc23-4438-be86-a5cc447bfdea tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:55.839596 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cb906df-cc23-4438-be86-a5cc447bfdea tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:55.840566 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cb906df-cc23-4438-be86-a5cc447bfdea tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:55.841004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cb906df-cc23-4438-be86-a5cc447bfdea tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:55.880464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-2cb906df-cc23-4438-be86-a5cc447bfdea tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lazy-loading 'flavor' on Instance uuid 446cfa38-0982-47b2-8e3f-a44a35257447 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:11:55.936204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c4ac7772-ee88-4276-951d-2889501178fe tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:55.955123 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c4ac7772-ee88-4276-951d-2889501178fe tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.713915 Aug 01 14:11:55.969163 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 178/366] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:55 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:55.990850 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b403b823-1dc4-49d4-a40d-8472864c0a2d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:55.992184 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b403b823-1dc4-49d4-a40d-8472864c0a2d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:56.015275 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b403b823-1dc4-49d4-a40d-8472864c0a2d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.016002 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b403b823-1dc4-49d4-a40d-8472864c0a2d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.026183 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b403b823-1dc4-49d4-a40d-8472864c0a2d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.027551 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b403b823-1dc4-49d4-a40d-8472864c0a2d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.173871 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b403b823-1dc4-49d4-a40d-8472864c0a2d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:56.186501 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b403b823-1dc4-49d4-a40d-8472864c0a2d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1204 microversion: 2.1 time: 0.215284 Aug 01 14:11:56.187098 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 179/367] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:55 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1204 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:56.192857 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c18dcfd3-5529-4ca9-96ee-69bfe4ce0e94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:56.194977 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c18dcfd3-5529-4ca9-96ee-69bfe4ce0e94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:56.196585 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2cb906df-cc23-4438-be86-a5cc447bfdea tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/action" status: 202 len: 0 microversion: 2.20 time: 0.376844 Aug 01 14:11:56.197424 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 189/368] 10.222.0.45 () {62 vars in 1319 bytes} [Mon Aug 1 14:11:55 2022] POST /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:11:56.205963 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd3-5529-4ca9-96ee-69bfe4ce0e94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.207019 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd3-5529-4ca9-96ee-69bfe4ce0e94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.208356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:56.209388 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:56.209548 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd3-5529-4ca9-96ee-69bfe4ce0e94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.210200 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd3-5529-4ca9-96ee-69bfe4ce0e94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.219020 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.219671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.220826 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.221496 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.705421 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c18dcfd3-5529-4ca9-96ee-69bfe4ce0e94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:56.720830 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c18dcfd3-5529-4ca9-96ee-69bfe4ce0e94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.532049 Aug 01 14:11:56.721790 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 180/369] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:56 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:56.776300 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:56.789842 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:56.794303 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:56.796520 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f932b9fe-8201-4a1a-8feb-f239556595e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.593953 Aug 01 14:11:56.812770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 190/370] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:11:56 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:11:56.835229 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-fdf7ec8d-5725-4607-8d6f-1208c6835dac tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:56.835581 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-fdf7ec8d-5725-4607-8d6f-1208c6835dac tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:56.846271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:56.851167 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fdf7ec8d-5725-4607-8d6f-1208c6835dac tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.852110 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fdf7ec8d-5725-4607-8d6f-1208c6835dac tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.853042 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fdf7ec8d-5725-4607-8d6f-1208c6835dac tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.853486 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fdf7ec8d-5725-4607-8d6f-1208c6835dac tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.920477 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0d1a8e32-c0da-4962-a25e-4ffba34655e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-96042402"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:56.921124 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0d1a8e32-c0da-4962-a25e-4ffba34655e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:56.930965 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d1a8e32-c0da-4962-a25e-4ffba34655e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.933306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d1a8e32-c0da-4962-a25e-4ffba34655e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.933774 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d1a8e32-c0da-4962-a25e-4ffba34655e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:56.934223 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d1a8e32-c0da-4962-a25e-4ffba34655e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:57.341819 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-fdf7ec8d-5725-4607-8d6f-1208c6835dac tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824b6455aab74659a9fb1e5e8f7c2965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803bbc59642547fb932be578cb70ac3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:57.352881 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-fdf7ec8d-5725-4607-8d6f-1208c6835dac tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 200 len: 1505 microversion: 2.1 time: 0.526420 Aug 01 14:11:57.354086 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 181/371] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:56 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:57.359740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b6d8f9c9-89e2-4ea3-866d-a0e2632a20ae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:57.364208 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b6d8f9c9-89e2-4ea3-866d-a0e2632a20ae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:57.373934 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b6d8f9c9-89e2-4ea3-866d-a0e2632a20ae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:57.375829 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b6d8f9c9-89e2-4ea3-866d-a0e2632a20ae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:57.376562 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b6d8f9c9-89e2-4ea3-866d-a0e2632a20ae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:57.377064 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b6d8f9c9-89e2-4ea3-866d-a0e2632a20ae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:57.419528 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.network.security_group_api [None req-0d1a8e32-c0da-4962-a25e-4ffba34655e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Adding security group 15fdec87-58f8-4692-a670-2b644260c755 to port 1bf0befb-0ac8-4221-a091-92283e46d506 Aug 01 14:11:57.866924 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b6d8f9c9-89e2-4ea3-866d-a0e2632a20ae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:57.877373 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b6d8f9c9-89e2-4ea3-866d-a0e2632a20ae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.521557 Aug 01 14:11:57.878651 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 182/372] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:57 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:57.884038 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4faadb6a-6c73-40c1-945c-16ef49e27a58 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:57.885193 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4faadb6a-6c73-40c1-945c-16ef49e27a58 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:57.892610 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4faadb6a-6c73-40c1-945c-16ef49e27a58 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:57.893090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4faadb6a-6c73-40c1-945c-16ef49e27a58 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:57.893840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4faadb6a-6c73-40c1-945c-16ef49e27a58 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:57.894274 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4faadb6a-6c73-40c1-945c-16ef49e27a58 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:58.289290 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4faadb6a-6c73-40c1-945c-16ef49e27a58 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:58.302101 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4faadb6a-6c73-40c1-945c-16ef49e27a58 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.421694 Aug 01 14:11:58.302930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 183/373] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:57 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:58.310682 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f781739b-3bf0-4518-b173-6ce281335653 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:58.311957 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f781739b-3bf0-4518-b173-6ce281335653 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:58.321781 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f781739b-3bf0-4518-b173-6ce281335653 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:58.322228 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f781739b-3bf0-4518-b173-6ce281335653 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:58.323011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f781739b-3bf0-4518-b173-6ce281335653 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:58.323525 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f781739b-3bf0-4518-b173-6ce281335653 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:58.843782 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0d1a8e32-c0da-4962-a25e-4ffba34655e5 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "POST /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/action" status: 202 len: 0 microversion: 2.1 time: 1.928892 Aug 01 14:11:58.844986 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 191/374] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:11:56 2022] POST /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/action => generated 0 bytes in 1931 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:11:58.852478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-e9849a4b-991d-4520-be20-9cb045eb1d17 req-4c2e4f91-33aa-4349-8a48-6b9274dc2cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d31bf2d4-54b7-42bc-b538-2482464fb82d", "name": "network-vif-deleted", "tag": "d18f8bb0-46f8-41e5-b2fb-b52607439b5e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:58.861162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:58.864476 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e9849a4b-991d-4520-be20-9cb045eb1d17 req-4c2e4f91-33aa-4349-8a48-6b9274dc2cf1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:58.865113 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e9849a4b-991d-4520-be20-9cb045eb1d17 req-4c2e4f91-33aa-4349-8a48-6b9274dc2cf1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:58.879733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-e9849a4b-991d-4520-be20-9cb045eb1d17 req-4c2e4f91-33aa-4349-8a48-6b9274dc2cf1 service nova] Creating event network-vif-deleted:d18f8bb0-46f8-41e5-b2fb-b52607439b5e for instance d31bf2d4-54b7-42bc-b538-2482464fb82d on hv-cinder-84517 Aug 01 14:11:58.886751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-e9849a4b-991d-4520-be20-9cb045eb1d17 req-4c2e4f91-33aa-4349-8a48-6b9274dc2cf1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039933 Aug 01 14:11:58.887503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 192/375] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:58.894233 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:58.895145 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:58.904821 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:58.906185 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:58.906845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:58.907158 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:58.990025 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f781739b-3bf0-4518-b173-6ce281335653 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:58.999962 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f781739b-3bf0-4518-b173-6ce281335653 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.695927 Aug 01 14:11:59.001462 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 184/376] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:58 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:59.007176 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:59.007988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] [instance: d31bf2d4-54b7-42bc-b538-2482464fb82d] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:59.015066 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.015834 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.016846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.017351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.037816 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] HTTP exception thrown: Instance d31bf2d4-54b7-42bc-b538-2482464fb82d could not be found. Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Request method failure captured: Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d HTTP/1.1 Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi597b_z_WQ8WktuJVYXse3tNv6mkGl-081mmMzjPGYkn8OqRdpf8y584kw2pTqojPKdVvFnZSlptN0HbQiKmufRxl5kA6Bn60W946bQHwgAkc04Owd3EYeQMu0xFtGPda-OQZo0wrPfXSMvLfFknysfUJnxT3blPElKb4kk0TTsvAHUI Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 803bbc59642547fb932be578cb70ac3f Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-VolumesActionsTest-915804991 Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:11:59.039195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_803bbc59642547fb932be578cb70ac3f", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/803bbc59642547fb932be578cb70ac3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/803bbc59642547fb932be578cb70ac3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/803bbc59642547fb932be578cb70ac3f"}]}] Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-VolumesActionsTest-915804991 Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 803bbc59642547fb932be578cb70ac3f Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-VolumesActionsTest-915804991 Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-VolumesActionsTest-915804991-project Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 824b6455aab74659a9fb1e5e8f7c2965 Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-VolumesActionsTest-915804991-project Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance d31bf2d4-54b7-42bc-b538-2482464fb82d could not be found. Aug 01 14:11:59.048755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': 'd31bf2d4-54b7-42bc-b538-2482464fb82d'} Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d31bf2d4-54b7-42bc-b538-2482464fb82d could not be found. Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:11:59.051925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d31bf2d4-54b7-42bc-b538-2482464fb82d could not be found. Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d31bf2d4-54b7-42bc-b538-2482464fb82d could not be found. Aug 01 14:11:59.057474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:11:59.059559 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] Returning 404 to user: Instance d31bf2d4-54b7-42bc-b538-2482464fb82d could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:11:59.059559 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-99d10be4-c608-44f7-97bc-8219ec7fb624 tempest-VolumesActionsTest-915804991 tempest-VolumesActionsTest-915804991-project] 10.222.0.45 "GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d" status: 404 len: 111 microversion: 2.1 time: 0.037928 Aug 01 14:11:59.059559 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 185/377] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:59 2022] GET /compute/v2.1/servers/d31bf2d4-54b7-42bc-b538-2482464fb82d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:11:59.059559 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-e1ad52e2-8f12-457e-b619-463e8619d123 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:59.059559 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-e1ad52e2-8f12-457e-b619-463e8619d123 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:59.061096 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e1ad52e2-8f12-457e-b619-463e8619d123 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.061810 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e1ad52e2-8f12-457e-b619-463e8619d123 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.063037 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e1ad52e2-8f12-457e-b619-463e8619d123 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.063493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e1ad52e2-8f12-457e-b619-463e8619d123 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.270308 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:59.291266 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:59.294400 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:59.296670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e03b0e3c-724f-4427-99f4-9e41e7efba82 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.407042 Aug 01 14:11:59.298430 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 193/378] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:11:58 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:11:59.305836 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-956b1520-4ee8-4e6b-9cfe-86c8ed2e6b24 req-cade6946-5993-41ac-abf7-12fae1636317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dd2869-e1f8-4607-8fc8-63858730bcc3", "tag": "1bf0befb-0ac8-4221-a091-92283e46d506"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:59.325124 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-956b1520-4ee8-4e6b-9cfe-86c8ed2e6b24 req-cade6946-5993-41ac-abf7-12fae1636317 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.325630 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-956b1520-4ee8-4e6b-9cfe-86c8ed2e6b24 req-cade6946-5993-41ac-abf7-12fae1636317 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.329067 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-e1ad52e2-8f12-457e-b619-463e8619d123 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:59.356068 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-e1ad52e2-8f12-457e-b619-463e8619d123 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1756 microversion: 2.1 time: 0.312574 Aug 01 14:11:59.357060 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 186/379] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:59 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1756 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:59.362780 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-cc854806-6be6-49c1-9ffb-7b35275b00dd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:59.363486 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-cc854806-6be6-49c1-9ffb-7b35275b00dd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:59.371093 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-956b1520-4ee8-4e6b-9cfe-86c8ed2e6b24 req-cade6946-5993-41ac-abf7-12fae1636317 service nova] Creating event network-changed:1bf0befb-0ac8-4221-a091-92283e46d506 for instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 on hv-cinder-84517 Aug 01 14:11:59.376362 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-956b1520-4ee8-4e6b-9cfe-86c8ed2e6b24 req-cade6946-5993-41ac-abf7-12fae1636317 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075873 Aug 01 14:11:59.376977 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 194/380] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:59.378731 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cc854806-6be6-49c1-9ffb-7b35275b00dd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.379188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cc854806-6be6-49c1-9ffb-7b35275b00dd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.381045 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cc854806-6be6-49c1-9ffb-7b35275b00dd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.381700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cc854806-6be6-49c1-9ffb-7b35275b00dd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.384128 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9b778118-758b-4e8a-bb00-f4ecce6f6366 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:59.385019 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9b778118-758b-4e8a-bb00-f4ecce6f6366 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:59.395979 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b778118-758b-4e8a-bb00-f4ecce6f6366 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.396481 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b778118-758b-4e8a-bb00-f4ecce6f6366 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.397250 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b778118-758b-4e8a-bb00-f4ecce6f6366 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.397835 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b778118-758b-4e8a-bb00-f4ecce6f6366 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.731995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9b778118-758b-4e8a-bb00-f4ecce6f6366 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:59.733227 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-cc854806-6be6-49c1-9ffb-7b35275b00dd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:59.749105 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-cc854806-6be6-49c1-9ffb-7b35275b00dd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.389291 Aug 01 14:11:59.749105 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 187/381] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:59 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:59.749628 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9b778118-758b-4e8a-bb00-f4ecce6f6366 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.367465 Aug 01 14:11:59.751306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 195/382] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:59 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:00.024124 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b3bda424-1132-4305-943e-6d8a75b72448 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:00.025506 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b3bda424-1132-4305-943e-6d8a75b72448 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:00.036462 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b3bda424-1132-4305-943e-6d8a75b72448 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.037312 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b3bda424-1132-4305-943e-6d8a75b72448 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:00.038174 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b3bda424-1132-4305-943e-6d8a75b72448 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.038794 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b3bda424-1132-4305-943e-6d8a75b72448 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:00.324363 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:00.324937 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:00.333994 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.334545 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:00.335404 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.335845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:00.383501 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b3bda424-1132-4305-943e-6d8a75b72448 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:00.391956 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b3bda424-1132-4305-943e-6d8a75b72448 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.374522 Aug 01 14:12:00.394526 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 188/383] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:00 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:00.510153 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:00.518672 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:00.520241 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:00.521442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-83aecacf-152d-4b4c-834c-3260bebbf969 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.201256 Aug 01 14:12:00.522010 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 196/384] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:00 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:00.780165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d5c98e0a-cdd5-44c4-bb49-1db22c999371 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:00.780869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d5c98e0a-cdd5-44c4-bb49-1db22c999371 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:00.783309 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=6 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:00.783893 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-542c917e-79c8-4003-a775-4e603635652b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:00.784056 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=16 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:00.785044 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-542c917e-79c8-4003-a775-4e603635652b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:00.790905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d5c98e0a-cdd5-44c4-bb49-1db22c999371 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.791346 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d5c98e0a-cdd5-44c4-bb49-1db22c999371 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:00.791898 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-542c917e-79c8-4003-a775-4e603635652b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.792112 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d5c98e0a-cdd5-44c4-bb49-1db22c999371 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.792369 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-542c917e-79c8-4003-a775-4e603635652b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:00.792574 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d5c98e0a-cdd5-44c4-bb49-1db22c999371 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:00.793149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-542c917e-79c8-4003-a775-4e603635652b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.793575 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-542c917e-79c8-4003-a775-4e603635652b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:01.002769 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d5c98e0a-cdd5-44c4-bb49-1db22c999371 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:01.005374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-542c917e-79c8-4003-a775-4e603635652b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:01.013670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-542c917e-79c8-4003-a775-4e603635652b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.234218 Aug 01 14:12:01.014364 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 197/385] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:00 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:01.018780 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d5c98e0a-cdd5-44c4-bb49-1db22c999371 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.242471 Aug 01 14:12:01.019642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 189/386] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:00 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:01.393484 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-76d32842-81b0-4d92-8812-61e48e843907 req-890d25fc-efde-4529-b491-c7f4cf9aeeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38da3c04-7cad-47ab-b253-e133bdeb480c", "tag": "ec79e886-ddb7-4769-af78-cfcf4186343e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:01.399841 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=8 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:01.409020 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-76d32842-81b0-4d92-8812-61e48e843907 req-890d25fc-efde-4529-b491-c7f4cf9aeeb4 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:01.409799 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-76d32842-81b0-4d92-8812-61e48e843907 req-890d25fc-efde-4529-b491-c7f4cf9aeeb4 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:01.415329 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8d69c46f-62aa-4809-bb9f-43d25576299f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:01.415947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8d69c46f-62aa-4809-bb9f-43d25576299f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:01.423638 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8d69c46f-62aa-4809-bb9f-43d25576299f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:01.424083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8d69c46f-62aa-4809-bb9f-43d25576299f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:01.424987 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8d69c46f-62aa-4809-bb9f-43d25576299f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:01.425454 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8d69c46f-62aa-4809-bb9f-43d25576299f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:01.428744 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:01.431721 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-76d32842-81b0-4d92-8812-61e48e843907 req-890d25fc-efde-4529-b491-c7f4cf9aeeb4 service nova] Creating event network-changed:ec79e886-ddb7-4769-af78-cfcf4186343e for instance 38da3c04-7cad-47ab-b253-e133bdeb480c on hv-cinder-84517 Aug 01 14:12:01.438501 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-76d32842-81b0-4d92-8812-61e48e843907 req-890d25fc-efde-4529-b491-c7f4cf9aeeb4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049546 Aug 01 14:12:01.439301 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 198/387] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:01.545456 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:01.546380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:01.557568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:01.558137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:01.559256 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:01.559864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:01.589755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8d69c46f-62aa-4809-bb9f-43d25576299f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:01.598049 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8d69c46f-62aa-4809-bb9f-43d25576299f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.186983 Aug 01 14:12:01.598650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 190/388] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:01 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:01.711648 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:01.720125 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:01.721740 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:01.723146 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a587feb8-aa4e-4675-a9c8-c86eebc29cfc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.182827 Aug 01 14:12:01.723734 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 199/389] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:01 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:02.035311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-92b9c741-aafc-4763-a589-de3382d1144a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:02.035960 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-92b9c741-aafc-4763-a589-de3382d1144a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:02.042965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92b9c741-aafc-4763-a589-de3382d1144a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.043324 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b07f7b3c-2071-401e-816e-cea46d9f7d69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:02.043509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92b9c741-aafc-4763-a589-de3382d1144a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:02.044223 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92b9c741-aafc-4763-a589-de3382d1144a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.044493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b07f7b3c-2071-401e-816e-cea46d9f7d69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:02.044676 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-92b9c741-aafc-4763-a589-de3382d1144a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:02.053268 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b07f7b3c-2071-401e-816e-cea46d9f7d69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.053732 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b07f7b3c-2071-401e-816e-cea46d9f7d69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:02.054608 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b07f7b3c-2071-401e-816e-cea46d9f7d69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.055047 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b07f7b3c-2071-401e-816e-cea46d9f7d69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:02.303431 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-92b9c741-aafc-4763-a589-de3382d1144a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:02.307332 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b07f7b3c-2071-401e-816e-cea46d9f7d69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:02.311869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-92b9c741-aafc-4763-a589-de3382d1144a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.280857 Aug 01 14:12:02.312489 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 191/390] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:02 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:02.316599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b07f7b3c-2071-401e-816e-cea46d9f7d69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.279984 Aug 01 14:12:02.317269 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 200/391] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:02 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:02.620953 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-17da77f1-8e42-4ad9-b491-ff5a04dcfb73 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:02.621538 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-17da77f1-8e42-4ad9-b491-ff5a04dcfb73 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:02.631475 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-17da77f1-8e42-4ad9-b491-ff5a04dcfb73 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.632210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-17da77f1-8e42-4ad9-b491-ff5a04dcfb73 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:02.633598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-17da77f1-8e42-4ad9-b491-ff5a04dcfb73 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.634347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-17da77f1-8e42-4ad9-b491-ff5a04dcfb73 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:02.748408 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:02.749482 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:02.758344 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.758798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:02.759624 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.760059 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:02.819001 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-17da77f1-8e42-4ad9-b491-ff5a04dcfb73 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:02.829166 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-17da77f1-8e42-4ad9-b491-ff5a04dcfb73 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.213221 Aug 01 14:12:02.841385 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 192/392] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:02 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:02.923160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:02.931892 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:02.933493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:02.934705 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cb441aee-24bb-48f9-b15d-46605530de13 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.190980 Aug 01 14:12:02.935273 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 201/393] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:02 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:03.335677 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-334e5654-174d-4f66-ac5f-cafc20b39cf8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:03.338608 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-334e5654-174d-4f66-ac5f-cafc20b39cf8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:03.348139 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-334e5654-174d-4f66-ac5f-cafc20b39cf8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:03.348415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7b15880a-08f0-4abb-8a9b-17cd960d6737 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:03.349094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-334e5654-174d-4f66-ac5f-cafc20b39cf8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:03.350162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7b15880a-08f0-4abb-8a9b-17cd960d6737 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:03.351439 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-334e5654-174d-4f66-ac5f-cafc20b39cf8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:03.352574 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-334e5654-174d-4f66-ac5f-cafc20b39cf8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:03.361858 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b15880a-08f0-4abb-8a9b-17cd960d6737 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:03.362449 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b15880a-08f0-4abb-8a9b-17cd960d6737 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:03.363206 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b15880a-08f0-4abb-8a9b-17cd960d6737 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:03.363739 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b15880a-08f0-4abb-8a9b-17cd960d6737 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:03.696971 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-334e5654-174d-4f66-ac5f-cafc20b39cf8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:03.705394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-334e5654-174d-4f66-ac5f-cafc20b39cf8 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.375726 Aug 01 14:12:03.706226 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 193/394] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:03 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:03.717129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7b15880a-08f0-4abb-8a9b-17cd960d6737 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:03.728536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7b15880a-08f0-4abb-8a9b-17cd960d6737 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.392488 Aug 01 14:12:03.729462 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 202/395] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:03 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:03.858499 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-50fbec82-e356-4c8f-8e26-d67957479ee5 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:03.859477 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-50fbec82-e356-4c8f-8e26-d67957479ee5 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:03.866949 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-50fbec82-e356-4c8f-8e26-d67957479ee5 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:03.867545 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-50fbec82-e356-4c8f-8e26-d67957479ee5 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:03.868485 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-50fbec82-e356-4c8f-8e26-d67957479ee5 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:03.869042 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-50fbec82-e356-4c8f-8e26-d67957479ee5 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:03.960236 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:03.961385 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:03.968447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:03.969183 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:03.971098 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:03.971800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:04.156432 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-50fbec82-e356-4c8f-8e26-d67957479ee5 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:04.168697 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-50fbec82-e356-4c8f-8e26-d67957479ee5 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.317782 Aug 01 14:12:04.169356 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 194/396] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:03 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:04.243406 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:04.252157 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:04.253750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:04.254952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a364712b-585e-4cdf-b060-1e27818a8dcd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.300721 Aug 01 14:12:04.255536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 203/397] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:03 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:04.729325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-020c0b43-24e7-4416-b7cb-7d23426445be tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:04.730074 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-020c0b43-24e7-4416-b7cb-7d23426445be tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:04.739543 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-020c0b43-24e7-4416-b7cb-7d23426445be tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.740249 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-020c0b43-24e7-4416-b7cb-7d23426445be tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:04.741575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-020c0b43-24e7-4416-b7cb-7d23426445be tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.742258 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-020c0b43-24e7-4416-b7cb-7d23426445be tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:04.751142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f8d22252-8fbc-4016-8c41-0c65c2f4d8e8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:04.751827 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f8d22252-8fbc-4016-8c41-0c65c2f4d8e8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:04.762788 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f8d22252-8fbc-4016-8c41-0c65c2f4d8e8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.763963 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f8d22252-8fbc-4016-8c41-0c65c2f4d8e8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:04.765170 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f8d22252-8fbc-4016-8c41-0c65c2f4d8e8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.765985 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f8d22252-8fbc-4016-8c41-0c65c2f4d8e8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.123409 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f8d22252-8fbc-4016-8c41-0c65c2f4d8e8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:05.126257 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-020c0b43-24e7-4416-b7cb-7d23426445be tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:05.151837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f8d22252-8fbc-4016-8c41-0c65c2f4d8e8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.404774 Aug 01 14:12:05.156634 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-020c0b43-24e7-4416-b7cb-7d23426445be tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.432649 Aug 01 14:12:05.158680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 204/398] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:04 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:05.172321 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 195/399] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:04 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:05.197637 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e8708d35-0476-4d99-b5ff-8eb1b88e69c3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:05.200393 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e8708d35-0476-4d99-b5ff-8eb1b88e69c3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:05.242850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e8708d35-0476-4d99-b5ff-8eb1b88e69c3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:05.244070 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e8708d35-0476-4d99-b5ff-8eb1b88e69c3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.251226 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e8708d35-0476-4d99-b5ff-8eb1b88e69c3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:05.252336 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e8708d35-0476-4d99-b5ff-8eb1b88e69c3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.279025 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:05.286901 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:05.288243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:05.300831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:05.304214 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.306503 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:05.307660 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.612580 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e8708d35-0476-4d99-b5ff-8eb1b88e69c3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:05.636228 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e8708d35-0476-4d99-b5ff-8eb1b88e69c3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.448843 Aug 01 14:12:05.647858 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 205/400] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:05 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:05.647858 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-a0fedda0-04e1-4108-a267-9f75801feaa3 req-d1671b7d-6a92-43bd-aaa4-7763a19ba95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7f31f9-adc0-4be6-92b9-0c2c99e14308", "name": "network-vif-plugged", "status": "completed", "tag": "754c5fad-2162-4018-96e9-5a8df36d546e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:05.666624 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a0fedda0-04e1-4108-a267-9f75801feaa3 req-d1671b7d-6a92-43bd-aaa4-7763a19ba95b service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:05.667059 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a0fedda0-04e1-4108-a267-9f75801feaa3 req-d1671b7d-6a92-43bd-aaa4-7763a19ba95b service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.686729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-a0fedda0-04e1-4108-a267-9f75801feaa3 req-d1671b7d-6a92-43bd-aaa4-7763a19ba95b service nova] Creating event network-vif-plugged:754c5fad-2162-4018-96e9-5a8df36d546e for instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 on hv-cinder-84517 Aug 01 14:12:05.692997 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-a0fedda0-04e1-4108-a267-9f75801feaa3 req-d1671b7d-6a92-43bd-aaa4-7763a19ba95b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053949 Aug 01 14:12:05.694261 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 206/401] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:05.697911 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:05.710151 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:05.712362 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:05.714148 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a84adddf-590e-4aab-a648-0fac5dd13649 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.436100 Aug 01 14:12:05.715254 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 196/402] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:05 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:06.184197 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-81188a2a-1d01-486a-98be-267a4d351dd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:06.185760 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-81188a2a-1d01-486a-98be-267a4d351dd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:06.194129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81188a2a-1d01-486a-98be-267a4d351dd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:06.194970 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81188a2a-1d01-486a-98be-267a4d351dd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:06.195957 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81188a2a-1d01-486a-98be-267a4d351dd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:06.196992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81188a2a-1d01-486a-98be-267a4d351dd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:06.292859 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3ddaf673-1443-45f4-a5b2-51136f05d2c9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:06.295415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3ddaf673-1443-45f4-a5b2-51136f05d2c9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:06.318461 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3ddaf673-1443-45f4-a5b2-51136f05d2c9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:06.326274 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3ddaf673-1443-45f4-a5b2-51136f05d2c9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:06.327761 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3ddaf673-1443-45f4-a5b2-51136f05d2c9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:06.328652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3ddaf673-1443-45f4-a5b2-51136f05d2c9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:06.375586 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-81188a2a-1d01-486a-98be-267a4d351dd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:06.392145 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-81188a2a-1d01-486a-98be-267a4d351dd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.212580 Aug 01 14:12:06.393522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 207/403] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:06 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:06.552906 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3ddaf673-1443-45f4-a5b2-51136f05d2c9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:06.569038 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3ddaf673-1443-45f4-a5b2-51136f05d2c9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.287568 Aug 01 14:12:06.571209 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 197/404] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:06 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:06.663865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-545e49e1-d63c-4192-83aa-84caaf6782b2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:06.664865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-545e49e1-d63c-4192-83aa-84caaf6782b2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:06.672758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-545e49e1-d63c-4192-83aa-84caaf6782b2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:06.673617 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-545e49e1-d63c-4192-83aa-84caaf6782b2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:06.674733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-545e49e1-d63c-4192-83aa-84caaf6782b2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:06.675633 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-545e49e1-d63c-4192-83aa-84caaf6782b2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:06.750497 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:06.751831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:06.763009 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:06.764317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:06.766474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:06.768415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:06.860724 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-545e49e1-d63c-4192-83aa-84caaf6782b2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:06.873264 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-545e49e1-d63c-4192-83aa-84caaf6782b2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1266 microversion: 2.1 time: 0.213265 Aug 01 14:12:06.888110 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 208/405] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:06 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:06.980819 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:06.995664 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:06.997503 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:06.998934 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-96f48ae2-c2b4-41ee-9405-f486da146821 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.256250 Aug 01 14:12:07.019796 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 198/406] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:06 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:07.424373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7534b70d-d448-4ec0-8e1d-4241d717960a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:07.425846 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7534b70d-d448-4ec0-8e1d-4241d717960a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:07.434243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7534b70d-d448-4ec0-8e1d-4241d717960a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.434693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7534b70d-d448-4ec0-8e1d-4241d717960a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.435516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7534b70d-d448-4ec0-8e1d-4241d717960a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.436173 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7534b70d-d448-4ec0-8e1d-4241d717960a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.595274 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2af8dd00-33d1-4dc1-8c54-85e3e40c2159 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:07.595959 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2af8dd00-33d1-4dc1-8c54-85e3e40c2159 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:07.609844 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2af8dd00-33d1-4dc1-8c54-85e3e40c2159 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.612683 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2af8dd00-33d1-4dc1-8c54-85e3e40c2159 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.615097 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2af8dd00-33d1-4dc1-8c54-85e3e40c2159 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.616167 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2af8dd00-33d1-4dc1-8c54-85e3e40c2159 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.782375 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7534b70d-d448-4ec0-8e1d-4241d717960a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:07.796550 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7534b70d-d448-4ec0-8e1d-4241d717960a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.376501 Aug 01 14:12:07.803301 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 209/407] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:07 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:07.897201 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c3314373-ee20-4e0b-9103-64b310dacea6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:07.897966 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c3314373-ee20-4e0b-9103-64b310dacea6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:07.915580 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c3314373-ee20-4e0b-9103-64b310dacea6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.916160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c3314373-ee20-4e0b-9103-64b310dacea6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.917092 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c3314373-ee20-4e0b-9103-64b310dacea6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.917591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c3314373-ee20-4e0b-9103-64b310dacea6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.967278 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2af8dd00-33d1-4dc1-8c54-85e3e40c2159 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:07.983037 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2af8dd00-33d1-4dc1-8c54-85e3e40c2159 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.394959 Aug 01 14:12:07.985021 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 199/408] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:07 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:08.033606 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:08.034895 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:08.046086 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:08.047055 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:08.048491 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:08.049254 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:08.183534 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c3314373-ee20-4e0b-9103-64b310dacea6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:08.195174 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c3314373-ee20-4e0b-9103-64b310dacea6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1453 microversion: 2.1 time: 0.302740 Aug 01 14:12:08.220327 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 210/409] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:07 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1453 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:08.242974 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cf2eb028-c4ac-40e3-a1b7-234a21fcaf10 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:08.243611 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cf2eb028-c4ac-40e3-a1b7-234a21fcaf10 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:08.252043 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf2eb028-c4ac-40e3-a1b7-234a21fcaf10 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:08.252839 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf2eb028-c4ac-40e3-a1b7-234a21fcaf10 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:08.253888 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf2eb028-c4ac-40e3-a1b7-234a21fcaf10 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:08.254517 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf2eb028-c4ac-40e3-a1b7-234a21fcaf10 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:08.372671 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:08.388473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:08.390032 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:08.391470 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ab3fc75b-0f16-472a-9799-689699b76c2e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.366961 Aug 01 14:12:08.396623 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 200/410] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:08 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:08.491812 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cf2eb028-c4ac-40e3-a1b7-234a21fcaf10 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:08.501660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cf2eb028-c4ac-40e3-a1b7-234a21fcaf10 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1453 microversion: 2.1 time: 0.275562 Aug 01 14:12:08.502376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 211/411] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:08 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1453 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:08.838233 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bda37451-f12a-45e5-b733-38d38a149d5e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:08.840339 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bda37451-f12a-45e5-b733-38d38a149d5e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:08.853927 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bda37451-f12a-45e5-b733-38d38a149d5e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:08.854778 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bda37451-f12a-45e5-b733-38d38a149d5e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:08.855995 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bda37451-f12a-45e5-b733-38d38a149d5e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:08.856667 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bda37451-f12a-45e5-b733-38d38a149d5e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:09.008200 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-08a69822-67aa-4f3e-b039-07349492f6c6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:09.008870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-08a69822-67aa-4f3e-b039-07349492f6c6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:09.017188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08a69822-67aa-4f3e-b039-07349492f6c6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:09.018176 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08a69822-67aa-4f3e-b039-07349492f6c6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:09.019553 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08a69822-67aa-4f3e-b039-07349492f6c6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:09.020240 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08a69822-67aa-4f3e-b039-07349492f6c6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:09.491683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-08a69822-67aa-4f3e-b039-07349492f6c6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:09.500636 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bda37451-f12a-45e5-b733-38d38a149d5e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:09.500983 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-08a69822-67aa-4f3e-b039-07349492f6c6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.497401 Aug 01 14:12:09.500983 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 212/412] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:09 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:09.513968 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bda37451-f12a-45e5-b733-38d38a149d5e tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.682769 Aug 01 14:12:09.531548 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:09.532710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:09.548576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:09.549422 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:09.551141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:09.552194 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:09.556086 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 201/413] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:08 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:09.850722 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:09.867011 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:09.870800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:09.872200 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5258b5c7-87b7-4f87-96b3-a99895db6bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.358596 Aug 01 14:12:09.874280 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 213/414] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:09 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:10.557089 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f25f004e-4093-4365-924e-0b271ef1778f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:10.561820 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f25f004e-4093-4365-924e-0b271ef1778f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:10.563491 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ac99f013-4e8d-4624-91fb-07cb20f09f00 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:10.564317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ac99f013-4e8d-4624-91fb-07cb20f09f00 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:10.579615 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac99f013-4e8d-4624-91fb-07cb20f09f00 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:10.580981 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f25f004e-4093-4365-924e-0b271ef1778f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:10.581480 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f25f004e-4093-4365-924e-0b271ef1778f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:10.582468 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f25f004e-4093-4365-924e-0b271ef1778f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:10.583260 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac99f013-4e8d-4624-91fb-07cb20f09f00 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:10.584169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac99f013-4e8d-4624-91fb-07cb20f09f00 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:10.584732 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac99f013-4e8d-4624-91fb-07cb20f09f00 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:10.590913 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f25f004e-4093-4365-924e-0b271ef1778f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:11.057329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f25f004e-4093-4365-924e-0b271ef1778f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:11.066408 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f25f004e-4093-4365-924e-0b271ef1778f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.519631 Aug 01 14:12:11.068900 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 214/415] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:10 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:11.089778 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:11.091041 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:11.095137 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ac99f013-4e8d-4624-91fb-07cb20f09f00 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:11.098779 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:11.099108 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:11.099903 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:11.100453 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:11.121430 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ac99f013-4e8d-4624-91fb-07cb20f09f00 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.591841 Aug 01 14:12:11.122028 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 202/416] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:10 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:11.441572 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:11.473385 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:11.482350 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:11.490766 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3991e331-ab47-46db-9561-dfc4368ce1aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.418370 Aug 01 14:12:11.492679 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 215/417] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:11 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:12.093325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2bea0af3-413e-4fea-a317-9883208f618d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:12.094731 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2bea0af3-413e-4fea-a317-9883208f618d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:12.105903 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2bea0af3-413e-4fea-a317-9883208f618d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:12.106414 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2bea0af3-413e-4fea-a317-9883208f618d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:12.107409 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2bea0af3-413e-4fea-a317-9883208f618d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:12.108221 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2bea0af3-413e-4fea-a317-9883208f618d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:12.146739 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-783b1b2d-64dd-46e2-81ee-01902a922ac0 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:12.148627 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-783b1b2d-64dd-46e2-81ee-01902a922ac0 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:12.181995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-783b1b2d-64dd-46e2-81ee-01902a922ac0 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:12.182442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-783b1b2d-64dd-46e2-81ee-01902a922ac0 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:12.183251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-783b1b2d-64dd-46e2-81ee-01902a922ac0 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:12.183685 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-783b1b2d-64dd-46e2-81ee-01902a922ac0 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:12.475824 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-783b1b2d-64dd-46e2-81ee-01902a922ac0 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:12.495728 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-783b1b2d-64dd-46e2-81ee-01902a922ac0 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.353282 Aug 01 14:12:12.499508 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 216/418] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:12 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:12.525516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-6a5e0a23-7b2d-4971-8bb3-6e7aec24d20d req-f6e8a129-d4aa-4f9f-96fb-5f2d872e7693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7f31f9-adc0-4be6-92b9-0c2c99e14308", "tag": "754c5fad-2162-4018-96e9-5a8df36d546e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:12.559870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-6a5e0a23-7b2d-4971-8bb3-6e7aec24d20d req-f6e8a129-d4aa-4f9f-96fb-5f2d872e7693 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:12.560508 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-6a5e0a23-7b2d-4971-8bb3-6e7aec24d20d req-f6e8a129-d4aa-4f9f-96fb-5f2d872e7693 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:12.570874 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2bea0af3-413e-4fea-a317-9883208f618d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:12.582235 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2bea0af3-413e-4fea-a317-9883208f618d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1677 microversion: 2.1 time: 0.493201 Aug 01 14:12:12.582874 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 203/419] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:12 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1677 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:12.588819 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:12.588819 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:12.595554 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:12.596004 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:12.596791 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-6a5e0a23-7b2d-4971-8bb3-6e7aec24d20d req-f6e8a129-d4aa-4f9f-96fb-5f2d872e7693 service nova] Creating event network-changed:754c5fad-2162-4018-96e9-5a8df36d546e for instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 on hv-cinder-84517 Aug 01 14:12:12.597026 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:12.597362 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:12.605447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-6a5e0a23-7b2d-4971-8bb3-6e7aec24d20d req-f6e8a129-d4aa-4f9f-96fb-5f2d872e7693 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104473 Aug 01 14:12:12.606536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 217/420] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:12.870301 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:12.881849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:12.886714 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:12.886714 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6e172bf1-3975-41fa-b27f-5eb494daded9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.301787 Aug 01 14:12:12.886714 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 204/421] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:12 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:13.543519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f812f2be-a0b3-40af-90d9-3edb4d8de133 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:13.543519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f812f2be-a0b3-40af-90d9-3edb4d8de133 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:13.558307 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f812f2be-a0b3-40af-90d9-3edb4d8de133 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.558760 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f812f2be-a0b3-40af-90d9-3edb4d8de133 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.559553 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f812f2be-a0b3-40af-90d9-3edb4d8de133 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.559986 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f812f2be-a0b3-40af-90d9-3edb4d8de133 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.606070 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8c59cec1-257d-48e9-8d5a-998725fa6a00 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:13.606771 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8c59cec1-257d-48e9-8d5a-998725fa6a00 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:13.627086 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8c59cec1-257d-48e9-8d5a-998725fa6a00 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.627805 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8c59cec1-257d-48e9-8d5a-998725fa6a00 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.631178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8c59cec1-257d-48e9-8d5a-998725fa6a00 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.632888 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8c59cec1-257d-48e9-8d5a-998725fa6a00 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.871582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8c59cec1-257d-48e9-8d5a-998725fa6a00 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:13.897008 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8c59cec1-257d-48e9-8d5a-998725fa6a00 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1654 microversion: 2.1 time: 0.294949 Aug 01 14:12:13.897931 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 205/422] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:13 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1654 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:13.919650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:13.920261 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:13.934346 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.934611 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.936969 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.942289 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.957996 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f812f2be-a0b3-40af-90d9-3edb4d8de133 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:13.989191 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f812f2be-a0b3-40af-90d9-3edb4d8de133 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.455585 Aug 01 14:12:13.989738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 218/423] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:13 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:14.022104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9d0cf7a3-0ae1-4684-b49a-ce6d1daff625 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:14.034358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d0cf7a3-0ae1-4684-b49a-ce6d1daff625 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:14.035389 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d0cf7a3-0ae1-4684-b49a-ce6d1daff625 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:14.150080 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9d0cf7a3-0ae1-4684-b49a-ce6d1daff625 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Going to try to start instance {{(pid=118111) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 14:12:14.173264 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:14.177787 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=100 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:14.194565 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:14.198914 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:14.200955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9cc1d746-5191-4940-84d8-e2423ee2403a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.285419 Aug 01 14:12:14.202178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 206/424] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:13 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:14.277598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9d0cf7a3-0ae1-4684-b49a-ce6d1daff625 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/action" status: 202 len: 0 microversion: 2.1 time: 0.261809 Aug 01 14:12:14.285053 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 219/425] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:12:13 2022] POST /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:12:14.292110 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c32946e9-7d60-4591-92e9-ec8a149a784f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:14.293753 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c32946e9-7d60-4591-92e9-ec8a149a784f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:14.309625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c32946e9-7d60-4591-92e9-ec8a149a784f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:14.313664 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c32946e9-7d60-4591-92e9-ec8a149a784f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:14.316694 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c32946e9-7d60-4591-92e9-ec8a149a784f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:14.319146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c32946e9-7d60-4591-92e9-ec8a149a784f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:14.698662 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c32946e9-7d60-4591-92e9-ec8a149a784f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:14.711949 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c32946e9-7d60-4591-92e9-ec8a149a784f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1663 microversion: 2.1 time: 0.422371 Aug 01 14:12:14.712812 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 207/426] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:14 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1663 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:15.023572 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8f65d740-2f84-4542-8957-266f3e5b9f21 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:15.024767 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8f65d740-2f84-4542-8957-266f3e5b9f21 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:15.054913 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f65d740-2f84-4542-8957-266f3e5b9f21 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.055520 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f65d740-2f84-4542-8957-266f3e5b9f21 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.056458 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f65d740-2f84-4542-8957-266f3e5b9f21 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.056962 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f65d740-2f84-4542-8957-266f3e5b9f21 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.251107 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:15.256084 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:15.266028 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.267268 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.268780 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.269790 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.321794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8f65d740-2f84-4542-8957-266f3e5b9f21 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:15.330429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8f65d740-2f84-4542-8957-266f3e5b9f21 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.312802 Aug 01 14:12:15.331063 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 220/427] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:15 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:15.507503 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:15.534526 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:15.538196 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:15.541115 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-245b3e23-cbc6-4695-a2a7-9776bf910a8f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.295224 Aug 01 14:12:15.562221 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 208/428] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:15 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:15.737004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6f1414b6-0ef6-46bc-8093-234d3f6bee5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:15.738262 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6f1414b6-0ef6-46bc-8093-234d3f6bee5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:15.750423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f1414b6-0ef6-46bc-8093-234d3f6bee5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.751242 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f1414b6-0ef6-46bc-8093-234d3f6bee5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.752230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f1414b6-0ef6-46bc-8093-234d3f6bee5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.752775 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f1414b6-0ef6-46bc-8093-234d3f6bee5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.810353 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-90fc76b8-6b56-40db-a546-1f4a5f0d11a4 req-d7b83ef6-b33f-4984-9794-95c4f15e9005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38da3c04-7cad-47ab-b253-e133bdeb480c", "name": "network-vif-plugged", "status": "completed", "tag": "ec79e886-ddb7-4769-af78-cfcf4186343e"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:15.825260 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-90fc76b8-6b56-40db-a546-1f4a5f0d11a4 req-d7b83ef6-b33f-4984-9794-95c4f15e9005 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.826168 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-90fc76b8-6b56-40db-a546-1f4a5f0d11a4 req-d7b83ef6-b33f-4984-9794-95c4f15e9005 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.876854 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-90fc76b8-6b56-40db-a546-1f4a5f0d11a4 req-d7b83ef6-b33f-4984-9794-95c4f15e9005 service nova] Creating event network-vif-plugged:ec79e886-ddb7-4769-af78-cfcf4186343e for instance 38da3c04-7cad-47ab-b253-e133bdeb480c on hv-cinder-84517 Aug 01 14:12:15.894215 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-90fc76b8-6b56-40db-a546-1f4a5f0d11a4 req-d7b83ef6-b33f-4984-9794-95c4f15e9005 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088916 Aug 01 14:12:15.895843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 209/429] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:15.994132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6f1414b6-0ef6-46bc-8093-234d3f6bee5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:16.004149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6f1414b6-0ef6-46bc-8093-234d3f6bee5f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1663 microversion: 2.1 time: 0.272070 Aug 01 14:12:16.006680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 221/430] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:15 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1663 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:16.356428 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-562f6a5d-7ee1-4ea7-8c47-572baf12d7ae tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:16.357399 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-562f6a5d-7ee1-4ea7-8c47-572baf12d7ae tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:16.364512 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-562f6a5d-7ee1-4ea7-8c47-572baf12d7ae tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:16.365239 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-562f6a5d-7ee1-4ea7-8c47-572baf12d7ae tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:16.366459 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-562f6a5d-7ee1-4ea7-8c47-572baf12d7ae tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:16.366843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-562f6a5d-7ee1-4ea7-8c47-572baf12d7ae tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:16.563484 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-562f6a5d-7ee1-4ea7-8c47-572baf12d7ae tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:16.584189 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:16.585812 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:16.587311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-562f6a5d-7ee1-4ea7-8c47-572baf12d7ae tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.235519 Aug 01 14:12:16.593825 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:16.594662 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:16.595851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:16.596553 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:16.602541 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 210/431] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:16 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:16.624415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:16.900679 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:16.908804 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:16.910750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:16.912112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2be1ab10-0dfd-4efd-90fd-4ebc315f5c57 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.333175 Aug 01 14:12:16.923181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 222/432] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:16 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:17.030000 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4f84f28d-2e01-4a95-b705-045f5f919540 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:17.031535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4f84f28d-2e01-4a95-b705-045f5f919540 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:17.042271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f84f28d-2e01-4a95-b705-045f5f919540 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.043025 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f84f28d-2e01-4a95-b705-045f5f919540 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:17.044315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f84f28d-2e01-4a95-b705-045f5f919540 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.045080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f84f28d-2e01-4a95-b705-045f5f919540 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:17.227353 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4f84f28d-2e01-4a95-b705-045f5f919540 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:17.241883 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4f84f28d-2e01-4a95-b705-045f5f919540 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1667 microversion: 2.1 time: 0.218894 Aug 01 14:12:17.243759 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 211/433] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:17 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1667 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:17.618732 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2cd96bf3-63d4-42d9-848a-516a0461b211 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:17.620838 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2cd96bf3-63d4-42d9-848a-516a0461b211 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:17.629729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd96bf3-63d4-42d9-848a-516a0461b211 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.630366 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd96bf3-63d4-42d9-848a-516a0461b211 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:17.631262 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd96bf3-63d4-42d9-848a-516a0461b211 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.632037 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd96bf3-63d4-42d9-848a-516a0461b211 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:17.873773 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2cd96bf3-63d4-42d9-848a-516a0461b211 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:17.884302 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2cd96bf3-63d4-42d9-848a-516a0461b211 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.274004 Aug 01 14:12:17.885026 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 223/434] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:17 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:17.935676 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:17.936507 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:17.943331 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.943755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:17.944604 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.945073 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:18.414514 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:18.426314 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:18.431210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:18.431210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-42dd5d3b-e74c-42f5-b1a1-8de37b1cbb6d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.498031 Aug 01 14:12:18.431210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 212/435] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:17 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:18.907925 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f9620258-4bea-4358-b207-da0bc08bde3d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:18.910193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f9620258-4bea-4358-b207-da0bc08bde3d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:18.918450 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f9620258-4bea-4358-b207-da0bc08bde3d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:18.918917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f9620258-4bea-4358-b207-da0bc08bde3d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:18.920147 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f9620258-4bea-4358-b207-da0bc08bde3d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:18.920615 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f9620258-4bea-4358-b207-da0bc08bde3d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:19.109875 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f9620258-4bea-4358-b207-da0bc08bde3d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:19.119230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f9620258-4bea-4358-b207-da0bc08bde3d tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1260 microversion: 2.1 time: 0.215704 Aug 01 14:12:19.130177 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 224/436] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:18 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:19.454897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:19.456163 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:19.463644 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:19.464423 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:19.465383 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:19.465819 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:19.705773 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:19.718420 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:19.720999 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:19.723378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6170ee54-b4a9-44bb-82e5-6476c45de36e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1746 microversion: 2.20 time: 0.272356 Aug 01 14:12:19.724642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 213/437] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:19 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1746 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:20.142442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-54cd2662-a1cd-43f3-9949-c4bfb3016178 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:20.143123 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-54cd2662-a1cd-43f3-9949-c4bfb3016178 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:20.150591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54cd2662-a1cd-43f3-9949-c4bfb3016178 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.151344 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54cd2662-a1cd-43f3-9949-c4bfb3016178 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.152139 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54cd2662-a1cd-43f3-9949-c4bfb3016178 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.152764 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54cd2662-a1cd-43f3-9949-c4bfb3016178 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.335625 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-54cd2662-a1cd-43f3-9949-c4bfb3016178 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:20.351710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-54cd2662-a1cd-43f3-9949-c4bfb3016178 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1443 microversion: 2.1 time: 0.212714 Aug 01 14:12:20.353988 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 225/438] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:20 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1443 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:20.375095 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5e34e649-755e-44df-aab7-d24024edde50 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:20.376305 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5e34e649-755e-44df-aab7-d24024edde50 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:20.385192 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e34e649-755e-44df-aab7-d24024edde50 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.385706 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e34e649-755e-44df-aab7-d24024edde50 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.386683 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e34e649-755e-44df-aab7-d24024edde50 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.387251 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e34e649-755e-44df-aab7-d24024edde50 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.603359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5e34e649-755e-44df-aab7-d24024edde50 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:20.640806 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5e34e649-755e-44df-aab7-d24024edde50 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1443 microversion: 2.1 time: 0.268395 Aug 01 14:12:20.645637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 214/439] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:20 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1443 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:20.757403 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:20.757403 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:20.766946 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.769353 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.770879 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.771383 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:21.022088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:21.029678 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:21.031332 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:21.033001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b403128a-2015-4baf-8e78-2d0d0d118280 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1746 microversion: 2.20 time: 0.288148 Aug 01 14:12:21.049008 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 226/440] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:20 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1746 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:21.769591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-adf6addc-d549-497c-8bad-83da0fa66975 req-a9c96625-5604-4347-b552-cba5625d7beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446cfa38-0982-47b2-8e3f-a44a35257447", "name": "network-vif-plugged", "status": "completed", "tag": "3c265e4a-7314-4d99-a248-2eb055ab90c0"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:21.790353 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-adf6addc-d549-497c-8bad-83da0fa66975 req-a9c96625-5604-4347-b552-cba5625d7beb service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:21.791311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-adf6addc-d549-497c-8bad-83da0fa66975 req-a9c96625-5604-4347-b552-cba5625d7beb service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:21.818121 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-adf6addc-d549-497c-8bad-83da0fa66975 req-a9c96625-5604-4347-b552-cba5625d7beb service nova] Creating event network-vif-plugged:3c265e4a-7314-4d99-a248-2eb055ab90c0 for instance 446cfa38-0982-47b2-8e3f-a44a35257447 on hv-cinder-84517 Aug 01 14:12:21.826550 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-adf6addc-d549-497c-8bad-83da0fa66975 req-a9c96625-5604-4347-b552-cba5625d7beb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063964 Aug 01 14:12:21.828966 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 215/441] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:22.061300 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:22.063481 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:22.083028 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:22.083485 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:22.084293 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:22.084723 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:22.322506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:22.339769 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:22.342283 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:22.343906 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5a590a24-dd32-4885-a054-b63f71d129f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1741 microversion: 2.20 time: 0.288705 Aug 01 14:12:22.358025 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 227/442] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:22 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1741 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:23.378057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:23.378057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:23.379800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:23.380483 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:23.381460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:23.382049 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:23.507933 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-c3434328-7b7b-4bb7-afe1-388f0d465d8b req-0aa88f25-1555-4194-8188-33bcf18a7ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38da3c04-7cad-47ab-b253-e133bdeb480c", "tag": "ec79e886-ddb7-4769-af78-cfcf4186343e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:23.522317 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c3434328-7b7b-4bb7-afe1-388f0d465d8b req-0aa88f25-1555-4194-8188-33bcf18a7ec1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:23.523770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c3434328-7b7b-4bb7-afe1-388f0d465d8b req-0aa88f25-1555-4194-8188-33bcf18a7ec1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:23.562702 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-c3434328-7b7b-4bb7-afe1-388f0d465d8b req-0aa88f25-1555-4194-8188-33bcf18a7ec1 service nova] Creating event network-changed:ec79e886-ddb7-4769-af78-cfcf4186343e for instance 38da3c04-7cad-47ab-b253-e133bdeb480c on hv-cinder-84517 Aug 01 14:12:23.571380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-c3434328-7b7b-4bb7-afe1-388f0d465d8b req-0aa88f25-1555-4194-8188-33bcf18a7ec1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069815 Aug 01 14:12:23.572003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 228/443] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:23.698241 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:23.716178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:23.720235 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:23.721673 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3f4b0814-811d-4731-9330-3567ced766a0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1741 microversion: 2.20 time: 0.355742 Aug 01 14:12:23.722889 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 216/444] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:23 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1741 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:24.750804 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:24.751645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:24.782786 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:24.783235 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:24.784650 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:24.786030 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:25.066316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:25.077743 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:25.080179 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:25.082264 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ba337846-9996-4e26-901a-7ff5b26fad8b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1741 microversion: 2.20 time: 0.337753 Aug 01 14:12:25.083666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 229/445] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:24 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1741 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:26.120367 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:26.123850 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:26.135187 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:26.135966 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:26.137231 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:26.137934 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:26.338994 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:26.360655 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:26.364185 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:26.367094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a135a51d-d12e-4925-ab5e-5cac64830ddd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1741 microversion: 2.20 time: 0.250383 Aug 01 14:12:26.370296 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 217/446] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:26 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:27.410188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:27.414706 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:27.435380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:27.436099 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:27.437175 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:27.438096 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:27.635031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:27.649807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:27.651966 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:27.653857 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f7f6aef5-7fe3-430d-af21-acf40f1d50c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1741 microversion: 2.20 time: 0.256702 Aug 01 14:12:27.655655 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 230/447] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:27 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:28.682676 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:28.684162 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:28.686477 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=74 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:28.696063 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:28.696545 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:28.697369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:28.697813 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:28.859815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:28.870304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:28.870304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:28.871022 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-72d36334-b5e8-48d6-ae99-1a0b7fafed73 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1741 microversion: 2.20 time: 0.195379 Aug 01 14:12:28.871463 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 218/448] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:28 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:29.900142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:29.900869 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:29.903422 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=78 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:29.918687 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:29.919149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:29.926394 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:29.926853 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:30.119765 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:30.130068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:30.131655 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:30.133090 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0d036301-0298-4a80-8c16-0f361724a950 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1741 microversion: 2.20 time: 0.238025 Aug 01 14:12:30.134367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 231/449] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:29 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:31.157522 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:31.158435 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:31.165942 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:31.166660 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:31.167449 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:31.168031 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:31.350863 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:31.360683 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:31.362456 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:31.365178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2dfb486b-1e42-4a87-9dc7-513607a6dd6b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1741 microversion: 2.20 time: 0.211411 Aug 01 14:12:31.366121 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 219/450] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:31 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:32.393516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:32.395737 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:32.405463 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:32.406279 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:32.407274 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:32.407707 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:32.660459 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:32.671000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:32.673130 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:32.674381 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bfec3dba-7332-4839-96dd-bdcd98c61ee7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1741 microversion: 2.20 time: 0.285308 Aug 01 14:12:32.674951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 232/451] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:32 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:33.699711 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:33.703037 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:33.713620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:33.714058 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:33.714814 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:33.715238 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:33.862012 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:33.870655 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:33.872171 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:33.873400 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d156fdb5-778f-4cda-8a34-4846d7002fca tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1723 microversion: 2.20 time: 0.178264 Aug 01 14:12:33.873964 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 220/452] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:33 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:34.896544 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:34.897179 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:34.903969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:34.904464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:34.905255 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:34.905711 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:35.054741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:35.063669 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:35.065216 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:35.066463 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7da89f9a-eca0-4279-ae38-44f25a5ec454 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1723 microversion: 2.20 time: 0.174257 Aug 01 14:12:35.067031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 233/453] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:34 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:35.735255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-68baeb50-3b5b-4fe0-839d-e4822732bc73 req-b6e5bbf4-0102-40cb-b313-9fcfafd4128e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446cfa38-0982-47b2-8e3f-a44a35257447", "name": "network-vif-unplugged", "status": "completed", "tag": "3c265e4a-7314-4d99-a248-2eb055ab90c0"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:35.745817 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-68baeb50-3b5b-4fe0-839d-e4822732bc73 req-b6e5bbf4-0102-40cb-b313-9fcfafd4128e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:35.746269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-68baeb50-3b5b-4fe0-839d-e4822732bc73 req-b6e5bbf4-0102-40cb-b313-9fcfafd4128e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:35.760244 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-68baeb50-3b5b-4fe0-839d-e4822732bc73 req-b6e5bbf4-0102-40cb-b313-9fcfafd4128e service nova] Creating event network-vif-unplugged:3c265e4a-7314-4d99-a248-2eb055ab90c0 for instance 446cfa38-0982-47b2-8e3f-a44a35257447 on hv-cinder-84517 Aug 01 14:12:35.765724 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-68baeb50-3b5b-4fe0-839d-e4822732bc73 req-b6e5bbf4-0102-40cb-b313-9fcfafd4128e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034131 Aug 01 14:12:35.766358 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 221/454] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:36.090373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:36.091076 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:36.098365 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:36.098887 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:36.099670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:36.100114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:36.255678 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:36.263962 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:36.265515 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:36.266682 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b41c678b-d81c-439a-a53c-6e4228ac4e5e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1723 microversion: 2.20 time: 0.180454 Aug 01 14:12:36.267271 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 234/455] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:36 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:37.293978 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:37.294737 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:37.302671 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:37.303117 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:37.303919 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:37.304375 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:37.456075 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:37.465003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:37.466527 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:37.467730 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-012ace83-5352-4b22-b88d-25d31dbfd092 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1666 microversion: 2.20 time: 0.180803 Aug 01 14:12:37.468317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 222/456] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:37 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1666 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:37.491565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-69b56ba6-0c6f-4e59-b8e6-9dde26966ff2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b3d3fcd-a957-433c-a18f-65dad11ca2e0"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:37.493965 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-69b56ba6-0c6f-4e59-b8e6-9dde26966ff2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:37.500955 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-69b56ba6-0c6f-4e59-b8e6-9dde26966ff2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:37.501520 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-69b56ba6-0c6f-4e59-b8e6-9dde26966ff2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:37.502165 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-69b56ba6-0c6f-4e59-b8e6-9dde26966ff2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:37.502590 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-69b56ba6-0c6f-4e59-b8e6-9dde26966ff2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:37.846910 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-69b56ba6-0c6f-4e59-b8e6-9dde26966ff2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.359329 Aug 01 14:12:37.847696 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 235/457] 10.222.0.45 () {62 vars in 1364 bytes} [Mon Aug 1 14:12:37 2022] POST /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments => generated 188 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:37.982567 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-47d509dd-913d-4cea-9d52-2eb6d196b09d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:37.983287 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-47d509dd-913d-4cea-9d52-2eb6d196b09d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:37.996311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-47d509dd-913d-4cea-9d52-2eb6d196b09d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:37.996311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-47d509dd-913d-4cea-9d52-2eb6d196b09d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:37.996311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-47d509dd-913d-4cea-9d52-2eb6d196b09d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:37.996311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-47d509dd-913d-4cea-9d52-2eb6d196b09d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:38.040717 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-47d509dd-913d-4cea-9d52-2eb6d196b09d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118110) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:12:38.123014 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-47d509dd-913d-4cea-9d52-2eb6d196b09d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/action" status: 202 len: 0 microversion: 2.20 time: 0.144340 Aug 01 14:12:38.126320 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 223/458] 10.222.0.45 () {62 vars in 1319 bytes} [Mon Aug 1 14:12:37 2022] POST /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:12:38.133243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:38.134140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:38.142311 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:38.142752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:38.143526 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:38.144149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:38.296588 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:38.299132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:38.307980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:38.311831 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:38.315579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a417ea4c-900d-4cd1-9765-c01875fbffcc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1752 microversion: 2.20 time: 0.187466 Aug 01 14:12:38.316002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 236/459] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:38 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:39.339779 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:39.340451 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:39.348566 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:39.349041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:39.349831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:39.350263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:39.367531 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:39.502516 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:39.511759 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:39.513317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:39.514484 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-af0693e1-dacc-4d25-8aee-18df243539fc tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1754 microversion: 2.20 time: 0.179574 Aug 01 14:12:39.515421 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 224/460] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:39 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:40.541781 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:40.542665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:40.552632 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:40.553090 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:40.554106 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:40.554313 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:40.726979 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:40.737340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:40.738958 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:40.740140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-99d3221a-280e-404a-863e-d4e02c07a22e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.205125 Aug 01 14:12:40.740739 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 237/461] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:40 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:41.572056 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2ecdcece-daf0-43d3-9208-8d1017ca5194 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d231e51d-b788-42cf-b91f-a29fc26fa865"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:41.574622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2ecdcece-daf0-43d3-9208-8d1017ca5194 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:41.582284 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ecdcece-daf0-43d3-9208-8d1017ca5194 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:41.582736 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ecdcece-daf0-43d3-9208-8d1017ca5194 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:41.583563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ecdcece-daf0-43d3-9208-8d1017ca5194 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:41.583995 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ecdcece-daf0-43d3-9208-8d1017ca5194 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:41.764336 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:41.765566 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:41.773850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:41.774324 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:41.775090 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:41.775513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:41.926883 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2ecdcece-daf0-43d3-9208-8d1017ca5194 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358117 Aug 01 14:12:41.928824 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 225/462] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:12:41 2022] POST /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:12:41.960763 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:41.980504 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:41.982841 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:41.984117 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0b8a870c-2c85-4010-891c-b55bd6169bd7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.224541 Aug 01 14:12:41.984722 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 238/463] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:41 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:42.501208 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2afca708-5206-4572-ae4d-c8d62a6a8b0a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:42.504446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2afca708-5206-4572-ae4d-c8d62a6a8b0a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:42.512116 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2afca708-5206-4572-ae4d-c8d62a6a8b0a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:42.512723 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2afca708-5206-4572-ae4d-c8d62a6a8b0a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:42.513670 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2afca708-5206-4572-ae4d-c8d62a6a8b0a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:42.514190 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2afca708-5206-4572-ae4d-c8d62a6a8b0a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:42.621185 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2afca708-5206-4572-ae4d-c8d62a6a8b0a tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "POST /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/action" status: 202 len: 0 microversion: 2.1 time: 0.124119 Aug 01 14:12:42.622081 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 226/464] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:12:42 2022] POST /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:12:42.634182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cd9cadb5-af95-4291-9ac7-ea29066fe014 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:42.634807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cd9cadb5-af95-4291-9ac7-ea29066fe014 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:42.648465 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd9cadb5-af95-4291-9ac7-ea29066fe014 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:42.649004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd9cadb5-af95-4291-9ac7-ea29066fe014 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:42.649771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd9cadb5-af95-4291-9ac7-ea29066fe014 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:42.650192 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd9cadb5-af95-4291-9ac7-ea29066fe014 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:42.829346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cd9cadb5-af95-4291-9ac7-ea29066fe014 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:42.838152 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cd9cadb5-af95-4291-9ac7-ea29066fe014 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.210779 Aug 01 14:12:42.841981 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 239/465] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:42 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:43.014626 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:43.015440 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:43.023201 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:43.023957 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:43.026267 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:43.026267 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:43.189151 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:43.200243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:43.203346 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:43.205053 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d066f14a-f7da-4c95-abe4-9077fe1fc0b1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.195408 Aug 01 14:12:43.206306 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 227/466] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:43 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:43.862603 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-95ff5e76-d8b2-4001-9786-31fd258ce9ea tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:43.864330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-95ff5e76-d8b2-4001-9786-31fd258ce9ea tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:43.872824 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-95ff5e76-d8b2-4001-9786-31fd258ce9ea tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:43.873469 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-95ff5e76-d8b2-4001-9786-31fd258ce9ea tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:43.874560 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-95ff5e76-d8b2-4001-9786-31fd258ce9ea tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:43.875246 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-95ff5e76-d8b2-4001-9786-31fd258ce9ea tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:44.046295 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-95ff5e76-d8b2-4001-9786-31fd258ce9ea tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:44.054979 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-95ff5e76-d8b2-4001-9786-31fd258ce9ea tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.196594 Aug 01 14:12:44.055574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 240/467] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:43 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:44.231001 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:44.231772 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:44.239606 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:44.239934 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:44.240691 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:44.241122 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:44.405957 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:44.421255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:44.424024 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:44.426012 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9acb58f3-9816-4550-9101-cc799b7b80bf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.198699 Aug 01 14:12:44.426873 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 228/468] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:44 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:45.076619 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1728c99c-fb21-4616-b2f9-c4e45d84c32d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:45.077462 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1728c99c-fb21-4616-b2f9-c4e45d84c32d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:45.086427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1728c99c-fb21-4616-b2f9-c4e45d84c32d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.086970 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1728c99c-fb21-4616-b2f9-c4e45d84c32d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.087973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1728c99c-fb21-4616-b2f9-c4e45d84c32d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.088784 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1728c99c-fb21-4616-b2f9-c4e45d84c32d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.316686 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1728c99c-fb21-4616-b2f9-c4e45d84c32d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:45.332605 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1728c99c-fb21-4616-b2f9-c4e45d84c32d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.259016 Aug 01 14:12:45.333759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 241/469] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:45 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:45.461894 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:45.462367 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:45.470276 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.470734 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.471522 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.471956 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.674192 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:45.684757 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:45.686317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:45.688440 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-aa8baceb-81e3-492e-b552-40e9c2255157 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.230696 Aug 01 14:12:45.688440 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 229/470] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:45 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:46.355755 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-442a2d09-7d71-4616-856a-881588d300c4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:46.356693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-442a2d09-7d71-4616-856a-881588d300c4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:46.375728 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-442a2d09-7d71-4616-856a-881588d300c4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.376187 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-442a2d09-7d71-4616-856a-881588d300c4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.376987 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-442a2d09-7d71-4616-856a-881588d300c4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.377675 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-442a2d09-7d71-4616-856a-881588d300c4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.579271 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-442a2d09-7d71-4616-856a-881588d300c4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.593050 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-442a2d09-7d71-4616-856a-881588d300c4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.242121 Aug 01 14:12:46.600861 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 242/471] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:46 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:46.717775 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:46.718458 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:46.729551 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.730347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.731327 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.732027 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.963496 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.979684 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.982644 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.987300 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8a32bb1f-fdbe-43c9-ad0f-e627a5c15090 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.270770 Aug 01 14:12:47.000826 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 230/472] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:46 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:47.626305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1679b469-8518-4a42-8cc9-d01765fea5de tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:47.627318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1679b469-8518-4a42-8cc9-d01765fea5de tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:47.640515 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1679b469-8518-4a42-8cc9-d01765fea5de tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.641070 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1679b469-8518-4a42-8cc9-d01765fea5de tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.642076 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1679b469-8518-4a42-8cc9-d01765fea5de tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.642691 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1679b469-8518-4a42-8cc9-d01765fea5de tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.862852 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1679b469-8518-4a42-8cc9-d01765fea5de tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:47.871803 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1679b469-8518-4a42-8cc9-d01765fea5de tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.252215 Aug 01 14:12:47.872440 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 243/473] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:47 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:48.028557 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:48.029273 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:48.037757 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:48.041637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:48.041637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:48.041637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:48.238535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:48.248739 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:48.250353 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:48.251581 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-7a06839c-745a-4912-89a5-6400725f196f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.227095 Aug 01 14:12:48.252420 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 231/474] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:48 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:48.898410 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bb5d7da0-f4a9-4287-bac8-04a7d8b3168b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:48.899649 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bb5d7da0-f4a9-4287-bac8-04a7d8b3168b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:48.912495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bb5d7da0-f4a9-4287-bac8-04a7d8b3168b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:48.913771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bb5d7da0-f4a9-4287-bac8-04a7d8b3168b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:48.915882 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bb5d7da0-f4a9-4287-bac8-04a7d8b3168b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:48.917035 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bb5d7da0-f4a9-4287-bac8-04a7d8b3168b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.116948 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bb5d7da0-f4a9-4287-bac8-04a7d8b3168b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:49.126421 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bb5d7da0-f4a9-4287-bac8-04a7d8b3168b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.235570 Aug 01 14:12:49.128293 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 244/475] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:48 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:49.282895 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:49.283594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:49.295649 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:49.296447 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.302446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:49.303854 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.622231 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:49.638440 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:49.640479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:49.642260 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f6ccbde7-e687-4d96-8969-146d0315a5a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.363483 Aug 01 14:12:49.643179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 232/476] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:49 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:50.153494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-246d4680-9c97-46e2-b9cf-50f844d2c501 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:50.155200 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-246d4680-9c97-46e2-b9cf-50f844d2c501 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:50.163835 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-246d4680-9c97-46e2-b9cf-50f844d2c501 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.164769 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-246d4680-9c97-46e2-b9cf-50f844d2c501 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.165802 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-246d4680-9c97-46e2-b9cf-50f844d2c501 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.166245 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-246d4680-9c97-46e2-b9cf-50f844d2c501 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.373413 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-246d4680-9c97-46e2-b9cf-50f844d2c501 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:50.384029 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-246d4680-9c97-46e2-b9cf-50f844d2c501 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.237301 Aug 01 14:12:50.384673 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 245/477] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:50 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:50.684421 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:50.686316 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:50.695571 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.696065 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.697250 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.703509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.935091 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:50.953919 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:50.956100 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:50.958809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6528bc3d-c259-4451-bf95-f90183e8721c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.279689 Aug 01 14:12:50.960750 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 233/478] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:50 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:51.417146 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-304a498b-16f5-4657-b2eb-a867db5f8fb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:51.417780 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-304a498b-16f5-4657-b2eb-a867db5f8fb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:51.426276 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-304a498b-16f5-4657-b2eb-a867db5f8fb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:51.427108 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-304a498b-16f5-4657-b2eb-a867db5f8fb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:51.427920 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-304a498b-16f5-4657-b2eb-a867db5f8fb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:51.428550 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-304a498b-16f5-4657-b2eb-a867db5f8fb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:51.666210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-304a498b-16f5-4657-b2eb-a867db5f8fb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:51.691673 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-304a498b-16f5-4657-b2eb-a867db5f8fb4 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.278156 Aug 01 14:12:51.696420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 246/479] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:51 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:51.994891 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:51.997153 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:52.009931 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:52.010833 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:52.012225 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:52.013336 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:52.200584 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:52.221105 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:52.224305 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:52.225803 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-945af4d2-1252-42d9-82cf-12bc64944179 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.238189 Aug 01 14:12:52.226789 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 234/480] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:51 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:52.715332 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-690a88f8-bd7d-4e9a-b69c-906ad47478c0 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:52.726665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-690a88f8-bd7d-4e9a-b69c-906ad47478c0 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:52.733918 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-690a88f8-bd7d-4e9a-b69c-906ad47478c0 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:52.734447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-690a88f8-bd7d-4e9a-b69c-906ad47478c0 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:52.735292 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-690a88f8-bd7d-4e9a-b69c-906ad47478c0 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:52.735818 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-690a88f8-bd7d-4e9a-b69c-906ad47478c0 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:52.900815 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-690a88f8-bd7d-4e9a-b69c-906ad47478c0 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:52.913670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-690a88f8-bd7d-4e9a-b69c-906ad47478c0 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.201963 Aug 01 14:12:52.916464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 247/481] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:52 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:53.250328 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:53.251203 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:53.258407 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:53.258853 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:53.259643 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:53.260145 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:53.415041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:53.425224 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:53.427048 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:53.428254 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-302dc49a-d102-4ba8-8d2f-697623c0d2ae tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.182135 Aug 01 14:12:53.428861 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 235/482] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:53 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:53.940574 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e9a66f43-f895-4bd9-a914-347b6a517f12 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:53.942021 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e9a66f43-f895-4bd9-a914-347b6a517f12 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:53.949814 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9a66f43-f895-4bd9-a914-347b6a517f12 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:53.950391 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9a66f43-f895-4bd9-a914-347b6a517f12 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:53.951348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9a66f43-f895-4bd9-a914-347b6a517f12 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:53.951881 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9a66f43-f895-4bd9-a914-347b6a517f12 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:54.123595 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e9a66f43-f895-4bd9-a914-347b6a517f12 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:54.139245 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e9a66f43-f895-4bd9-a914-347b6a517f12 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.203587 Aug 01 14:12:54.139755 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 248/483] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:53 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:54.454316 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:54.455302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:54.463839 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:54.464294 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:54.465146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:54.465573 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:54.642088 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:54.651176 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:54.652729 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:54.653914 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ca68bcf7-6ecb-49b5-95ce-b65f3148c349 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.205884 Aug 01 14:12:54.654485 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 236/484] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:54 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:55.173481 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2b74159f-dedf-403c-a100-42a5619850cd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:55.174321 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2b74159f-dedf-403c-a100-42a5619850cd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:55.181671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b74159f-dedf-403c-a100-42a5619850cd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:55.182118 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b74159f-dedf-403c-a100-42a5619850cd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:55.182891 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b74159f-dedf-403c-a100-42a5619850cd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:55.183325 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b74159f-dedf-403c-a100-42a5619850cd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:55.348683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2b74159f-dedf-403c-a100-42a5619850cd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:55.358260 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2b74159f-dedf-403c-a100-42a5619850cd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.191034 Aug 01 14:12:55.358860 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 249/485] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:55 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:55.677891 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:55.679081 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:55.686532 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:55.686974 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:55.687753 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:55.688183 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:55.851250 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:55.861637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:55.863148 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:55.864406 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2e22a870-17a1-4373-9982-58ac911573e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.190815 Aug 01 14:12:55.865015 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 237/486] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:55 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:56.379795 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-65ac56b5-b15a-4ed5-a0f1-602b8e5c95e9 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:56.380691 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-65ac56b5-b15a-4ed5-a0f1-602b8e5c95e9 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:56.388051 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-65ac56b5-b15a-4ed5-a0f1-602b8e5c95e9 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:56.388630 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-65ac56b5-b15a-4ed5-a0f1-602b8e5c95e9 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:56.389428 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-65ac56b5-b15a-4ed5-a0f1-602b8e5c95e9 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:56.389875 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-65ac56b5-b15a-4ed5-a0f1-602b8e5c95e9 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:56.893641 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:56.895029 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:56.905101 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-65ac56b5-b15a-4ed5-a0f1-602b8e5c95e9 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:56.907645 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:56.908575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:56.911449 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:56.911449 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:56.916155 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-65ac56b5-b15a-4ed5-a0f1-602b8e5c95e9 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1748 microversion: 2.1 time: 0.540380 Aug 01 14:12:56.916806 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 250/487] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:56 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1748 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:57.095095 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:57.097549 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:57.105425 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:57.106941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:57.108152 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c01a57b3-eda4-48ea-8b94-7b9b36ce2c7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.223031 Aug 01 14:12:57.108752 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 238/488] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:56 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:57.951544 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ad39f885-0f94-477a-a813-d583a236a756 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:57.952372 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ad39f885-0f94-477a-a813-d583a236a756 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:57.961631 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad39f885-0f94-477a-a813-d583a236a756 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:57.962756 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad39f885-0f94-477a-a813-d583a236a756 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:57.963982 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad39f885-0f94-477a-a813-d583a236a756 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:57.964575 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad39f885-0f94-477a-a813-d583a236a756 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:58.134458 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:58.135245 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:58.138794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ad39f885-0f94-477a-a813-d583a236a756 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:58.143601 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:58.144045 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:58.144978 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:58.145467 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:58.167385 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ad39f885-0f94-477a-a813-d583a236a756 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.219568 Aug 01 14:12:58.168690 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 251/489] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:57 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:58.315081 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:58.323887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:58.325473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:58.327470 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a6f50fc9-239a-45c6-a966-f89489920071 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.196293 Aug 01 14:12:58.327470 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 239/490] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:58 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:59.194691 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-62bb195d-c0a1-4da4-be86-aa7a2b620a8e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:59.195704 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-62bb195d-c0a1-4da4-be86-aa7a2b620a8e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:59.202722 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-62bb195d-c0a1-4da4-be86-aa7a2b620a8e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:59.203164 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-62bb195d-c0a1-4da4-be86-aa7a2b620a8e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:59.203943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-62bb195d-c0a1-4da4-be86-aa7a2b620a8e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:59.204409 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-62bb195d-c0a1-4da4-be86-aa7a2b620a8e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:59.350922 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:59.351548 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:59.354354 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:59.368147 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-62bb195d-c0a1-4da4-be86-aa7a2b620a8e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:59.368694 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:59.369304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:59.370330 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:59.371845 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:59.378500 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-62bb195d-c0a1-4da4-be86-aa7a2b620a8e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.188030 Aug 01 14:12:59.379137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 252/491] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:59 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:59.538620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:59.549063 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:59.550589 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:59.552397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b1470825-6f8c-4172-8649-2fd59d23f29f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.205082 Aug 01 14:12:59.552397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 240/492] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:59 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:00.404956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b31095f6-9c77-4f22-865e-8e01e2b6391e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:00.405798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b31095f6-9c77-4f22-865e-8e01e2b6391e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:00.409830 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=44 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:00.416137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b31095f6-9c77-4f22-865e-8e01e2b6391e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:00.416685 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b31095f6-9c77-4f22-865e-8e01e2b6391e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:00.417471 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b31095f6-9c77-4f22-865e-8e01e2b6391e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:00.417901 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b31095f6-9c77-4f22-865e-8e01e2b6391e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:00.434329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:00.577897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:00.578695 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:00.581587 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b31095f6-9c77-4f22-865e-8e01e2b6391e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:00.585902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:00.586389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:00.587220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:00.587674 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:00.591530 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b31095f6-9c77-4f22-865e-8e01e2b6391e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.193357 Aug 01 14:13:00.592132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 253/493] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:00 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:00.737979 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:00.747650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:00.749243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:00.750509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d8f2c486-fad8-49fa-803b-8afef5b09b2b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.177361 Aug 01 14:13:00.751028 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 241/494] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:00 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:01.613668 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4d9b22af-3104-4ba8-b47f-9fad9fad8e91 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:01.614240 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4d9b22af-3104-4ba8-b47f-9fad9fad8e91 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:01.621889 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d9b22af-3104-4ba8-b47f-9fad9fad8e91 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:01.622333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d9b22af-3104-4ba8-b47f-9fad9fad8e91 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:01.623569 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d9b22af-3104-4ba8-b47f-9fad9fad8e91 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:01.624205 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d9b22af-3104-4ba8-b47f-9fad9fad8e91 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:01.775638 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:01.776325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:01.783530 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:01.783971 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:01.785734 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:01.786321 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:01.788408 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4d9b22af-3104-4ba8-b47f-9fad9fad8e91 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:01.802564 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4d9b22af-3104-4ba8-b47f-9fad9fad8e91 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.192752 Aug 01 14:13:01.803422 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 254/495] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:01 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:01.993395 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:02.005481 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:02.007041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:02.008304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2858562a-e4c1-46cc-bb5c-f130d65fbaee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.237674 Aug 01 14:13:02.008876 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 242/496] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:01 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:02.828559 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c190e305-c02b-41a2-b1af-7701a9905f1c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:02.829156 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c190e305-c02b-41a2-b1af-7701a9905f1c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:02.835681 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c190e305-c02b-41a2-b1af-7701a9905f1c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:02.836145 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c190e305-c02b-41a2-b1af-7701a9905f1c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:02.837114 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c190e305-c02b-41a2-b1af-7701a9905f1c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:02.837398 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c190e305-c02b-41a2-b1af-7701a9905f1c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:03.033196 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:03.034052 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:03.042313 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c190e305-c02b-41a2-b1af-7701a9905f1c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:03.045021 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:03.045868 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:03.048109 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:03.049493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:03.055116 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c190e305-c02b-41a2-b1af-7701a9905f1c tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.230140 Aug 01 14:13:03.056830 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 255/497] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:02 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:03.263542 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:03.275841 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:03.277392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:03.278597 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d3e09612-cda5-43a1-a1a0-684e234b691d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.250262 Aug 01 14:13:03.279165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 243/498] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:03 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:04.091077 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-745d8c5a-a25f-41b4-a093-6cac18799641 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:04.091671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-745d8c5a-a25f-41b4-a093-6cac18799641 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:04.098705 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-745d8c5a-a25f-41b4-a093-6cac18799641 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.099149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-745d8c5a-a25f-41b4-a093-6cac18799641 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:04.099902 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-745d8c5a-a25f-41b4-a093-6cac18799641 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.100370 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-745d8c5a-a25f-41b4-a093-6cac18799641 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:04.255530 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-745d8c5a-a25f-41b4-a093-6cac18799641 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:04.264597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-745d8c5a-a25f-41b4-a093-6cac18799641 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.177406 Aug 01 14:13:04.265213 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 256/499] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:04 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:04.311632 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:04.312485 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:04.322291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.322729 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:04.323538 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.323968 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:04.477549 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:04.486726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:04.488291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:04.489524 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6bd8ab44-52ab-465a-b8bc-ddc90a36c89a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.182328 Aug 01 14:13:04.490105 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 244/500] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:04 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:04.788684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-822203541", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:04.858847 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] validate_networks() for None {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:13:05.148622 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:13:05.149213 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:13:05.149493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:13:05.149897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:13:05.150302 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:13:05.161433 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.161433 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.162204 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.162642 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.185666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Getting quotas for project 88aec08b7ce54cb5ad87ea544a819e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:13:05.194250 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Getting quotas for user 9a882cf9cc15457bb5a860963f1967f2 and project 88aec08b7ce54cb5ad87ea544a819e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:13:05.205096 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:13:05.207544 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:13:05.261565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3bf36399-56e7-40ac-b21d-0193c08c2147 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.477008 Aug 01 14:13:05.262127 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 257/501] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:13:05.274539 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-059560f3-60c8-46fd-a0b1-c878e0627557 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:05.275155 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-059560f3-60c8-46fd-a0b1-c878e0627557 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:05.286929 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b7af5ecf-fbaf-4ab3-998d-b35d3460e58b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:05.287502 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b7af5ecf-fbaf-4ab3-998d-b35d3460e58b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:05.295104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b7af5ecf-fbaf-4ab3-998d-b35d3460e58b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.295872 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b7af5ecf-fbaf-4ab3-998d-b35d3460e58b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.296317 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b7af5ecf-fbaf-4ab3-998d-b35d3460e58b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.296786 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b7af5ecf-fbaf-4ab3-998d-b35d3460e58b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.336169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-059560f3-60c8-46fd-a0b1-c878e0627557 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.343992 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-059560f3-60c8-46fd-a0b1-c878e0627557 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1214 microversion: 2.1 time: 0.073694 Aug 01 14:13:05.344505 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 245/502] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:05 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:05.487117 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b7af5ecf-fbaf-4ab3-998d-b35d3460e58b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.500535 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b7af5ecf-fbaf-4ab3-998d-b35d3460e58b tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.218292 Aug 01 14:13:05.501241 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 258/503] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:05 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:05.513908 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:05.514552 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:05.523712 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.524377 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.525165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.525604 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.722420 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.733680 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.736396 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.737722 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d3e84798-a78a-4389-bc9e-5af3013ea2c5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.228485 Aug 01 14:13:05.738540 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 246/504] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:05 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:06.366544 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c756fabd-94d8-44e9-afbd-6a4e7a7a0511 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:06.367451 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c756fabd-94d8-44e9-afbd-6a4e7a7a0511 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:06.375773 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c756fabd-94d8-44e9-afbd-6a4e7a7a0511 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.376225 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c756fabd-94d8-44e9-afbd-6a4e7a7a0511 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.377061 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c756fabd-94d8-44e9-afbd-6a4e7a7a0511 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.377500 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c756fabd-94d8-44e9-afbd-6a4e7a7a0511 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.449505 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c756fabd-94d8-44e9-afbd-6a4e7a7a0511 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:06.462978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c756fabd-94d8-44e9-afbd-6a4e7a7a0511 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1218 microversion: 2.1 time: 0.101039 Aug 01 14:13:06.463961 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 259/505] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:06 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:06.522969 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-25926637-5da2-4bb1-b16c-0373c3fa7cdd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:06.523712 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-25926637-5da2-4bb1-b16c-0373c3fa7cdd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:06.530889 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-25926637-5da2-4bb1-b16c-0373c3fa7cdd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.531617 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-25926637-5da2-4bb1-b16c-0373c3fa7cdd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.532146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-25926637-5da2-4bb1-b16c-0373c3fa7cdd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.532601 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-25926637-5da2-4bb1-b16c-0373c3fa7cdd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.696690 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-25926637-5da2-4bb1-b16c-0373c3fa7cdd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:06.712209 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-25926637-5da2-4bb1-b16c-0373c3fa7cdd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.193180 Aug 01 14:13:06.712831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 247/506] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:06 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:06.761789 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:06.762588 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:06.769031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.769464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.770315 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.770743 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.936249 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:06.945606 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:06.947105 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:06.948297 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b1ce2d9d-5e67-40e3-b630-2941b1b6da5f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.190501 Aug 01 14:13:06.948908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 260/507] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:06 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:07.488441 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3da3033a-45ca-4133-a57c-a4bc372aa45f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:07.489175 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3da3033a-45ca-4133-a57c-a4bc372aa45f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:07.501396 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3da3033a-45ca-4133-a57c-a4bc372aa45f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.501831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3da3033a-45ca-4133-a57c-a4bc372aa45f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.502602 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3da3033a-45ca-4133-a57c-a4bc372aa45f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.503028 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3da3033a-45ca-4133-a57c-a4bc372aa45f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.573902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3da3033a-45ca-4133-a57c-a4bc372aa45f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:07.582003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3da3033a-45ca-4133-a57c-a4bc372aa45f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1218 microversion: 2.1 time: 0.097590 Aug 01 14:13:07.582656 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 248/508] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:07 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:07.735094 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d38b50e0-5f55-470d-ac47-5c8a626e9af3 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:07.735833 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d38b50e0-5f55-470d-ac47-5c8a626e9af3 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:07.746203 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d38b50e0-5f55-470d-ac47-5c8a626e9af3 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.746669 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d38b50e0-5f55-470d-ac47-5c8a626e9af3 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.747829 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d38b50e0-5f55-470d-ac47-5c8a626e9af3 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.748348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d38b50e0-5f55-470d-ac47-5c8a626e9af3 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.919301 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d38b50e0-5f55-470d-ac47-5c8a626e9af3 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:07.928983 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d38b50e0-5f55-470d-ac47-5c8a626e9af3 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.198279 Aug 01 14:13:07.929965 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 261/509] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:07 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:07.972643 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:07.973549 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:07.979954 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.980587 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.981232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.981666 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.121292 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:08.130088 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:08.131581 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:08.132774 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-452bf9b7-2895-4ab8-b3b1-110881e773b2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.164273 Aug 01 14:13:08.133340 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 249/510] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:07 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:08.604159 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5c8cd52c-cbf6-49e8-ae33-e07ead467f82 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:08.604975 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5c8cd52c-cbf6-49e8-ae33-e07ead467f82 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:08.612063 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c8cd52c-cbf6-49e8-ae33-e07ead467f82 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.612525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c8cd52c-cbf6-49e8-ae33-e07ead467f82 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.613351 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c8cd52c-cbf6-49e8-ae33-e07ead467f82 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.613760 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c8cd52c-cbf6-49e8-ae33-e07ead467f82 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.680564 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5c8cd52c-cbf6-49e8-ae33-e07ead467f82 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:08.689390 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5c8cd52c-cbf6-49e8-ae33-e07ead467f82 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1218 microversion: 2.1 time: 0.089298 Aug 01 14:13:08.690083 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 262/511] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:08 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:08.693073 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-cd6846ac-e49e-43f0-a6f8-6eaa46834821 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:08.696842 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-cd6846ac-e49e-43f0-a6f8-6eaa46834821 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:08.705744 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cd6846ac-e49e-43f0-a6f8-6eaa46834821 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.706222 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cd6846ac-e49e-43f0-a6f8-6eaa46834821 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.707888 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cd6846ac-e49e-43f0-a6f8-6eaa46834821 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.708325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cd6846ac-e49e-43f0-a6f8-6eaa46834821 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.746650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-cd6846ac-e49e-43f0-a6f8-6eaa46834821 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057742 Aug 01 14:13:08.747233 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 250/512] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:13:08 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 14:13:08.812996 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fb93cc55-3a5d-483d-9076-1aabdd73a09d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:08.813534 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fb93cc55-3a5d-483d-9076-1aabdd73a09d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:08.820266 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb93cc55-3a5d-483d-9076-1aabdd73a09d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.820769 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb93cc55-3a5d-483d-9076-1aabdd73a09d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.821530 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb93cc55-3a5d-483d-9076-1aabdd73a09d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.821954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb93cc55-3a5d-483d-9076-1aabdd73a09d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.850693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fb93cc55-3a5d-483d-9076-1aabdd73a09d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:13:08.938516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fb93cc55-3a5d-483d-9076-1aabdd73a09d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 204 len: 0 microversion: 2.1 time: 0.129092 Aug 01 14:13:08.939123 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 263/513] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:13:08 2022] DELETE /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:13:08.948198 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-fb3f9fc1-1f8d-4d6b-bd42-7c47f1a99370 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:08.948920 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-fb3f9fc1-1f8d-4d6b-bd42-7c47f1a99370 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:08.953242 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-71f7ed2c-b171-4ca4-a98f-b947468ea625 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:08.953921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-71f7ed2c-b171-4ca4-a98f-b947468ea625 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:08.956306 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb3f9fc1-1f8d-4d6b-bd42-7c47f1a99370 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.957068 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb3f9fc1-1f8d-4d6b-bd42-7c47f1a99370 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.958686 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb3f9fc1-1f8d-4d6b-bd42-7c47f1a99370 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.959116 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb3f9fc1-1f8d-4d6b-bd42-7c47f1a99370 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.960951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71f7ed2c-b171-4ca4-a98f-b947468ea625 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.961524 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71f7ed2c-b171-4ca4-a98f-b947468ea625 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.962348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71f7ed2c-b171-4ca4-a98f-b947468ea625 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.962754 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71f7ed2c-b171-4ca4-a98f-b947468ea625 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.167227 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-fb3f9fc1-1f8d-4d6b-bd42-7c47f1a99370 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:09.179243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-fb3f9fc1-1f8d-4d6b-bd42-7c47f1a99370 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1673 microversion: 2.1 time: 0.234989 Aug 01 14:13:09.180417 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 251/514] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:08 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:09.186118 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:09.186738 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:09.188738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-71f7ed2c-b171-4ca4-a98f-b947468ea625 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:09.193552 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.193996 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.194782 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.195205 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.197822 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-71f7ed2c-b171-4ca4-a98f-b947468ea625 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.249071 Aug 01 14:13:09.198389 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 264/515] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:08 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:09.334397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:09.344511 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:09.347452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:09.348144 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4bb60d61-a158-44aa-b584-484ce1a18fcf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.166655 Aug 01 14:13:09.348772 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 252/516] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:09 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:09.710995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-23d615f6-b5a2-413e-8aea-1385b8647c62 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:09.711701 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-23d615f6-b5a2-413e-8aea-1385b8647c62 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:09.718781 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-23d615f6-b5a2-413e-8aea-1385b8647c62 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.719235 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-23d615f6-b5a2-413e-8aea-1385b8647c62 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.720008 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-23d615f6-b5a2-413e-8aea-1385b8647c62 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.720490 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-23d615f6-b5a2-413e-8aea-1385b8647c62 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.799326 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-23d615f6-b5a2-413e-8aea-1385b8647c62 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:09.808012 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-23d615f6-b5a2-413e-8aea-1385b8647c62 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1218 microversion: 2.1 time: 0.101034 Aug 01 14:13:09.808649 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 265/517] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:09 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:10.202350 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c74c76a0-1e9c-4a0f-9fb4-1669ccd49749 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:10.202978 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c74c76a0-1e9c-4a0f-9fb4-1669ccd49749 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:10.210461 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c74c76a0-1e9c-4a0f-9fb4-1669ccd49749 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.210913 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c74c76a0-1e9c-4a0f-9fb4-1669ccd49749 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.211861 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c74c76a0-1e9c-4a0f-9fb4-1669ccd49749 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.212553 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c74c76a0-1e9c-4a0f-9fb4-1669ccd49749 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.221037 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-25cb9836-c93a-4cf5-8047-6ae603ac4e71 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:10.221830 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-25cb9836-c93a-4cf5-8047-6ae603ac4e71 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:10.230064 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25cb9836-c93a-4cf5-8047-6ae603ac4e71 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.230518 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25cb9836-c93a-4cf5-8047-6ae603ac4e71 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.231325 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25cb9836-c93a-4cf5-8047-6ae603ac4e71 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.231765 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25cb9836-c93a-4cf5-8047-6ae603ac4e71 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.474793 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c74c76a0-1e9c-4a0f-9fb4-1669ccd49749 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.484006 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c74c76a0-1e9c-4a0f-9fb4-1669ccd49749 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1673 microversion: 2.1 time: 0.285430 Aug 01 14:13:10.484846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 253/518] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:10 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1673 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:10.497222 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:10.497897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:10.506540 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.506540 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.506540 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.506943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-25cb9836-c93a-4cf5-8047-6ae603ac4e71 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.507076 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.514762 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-25cb9836-c93a-4cf5-8047-6ae603ac4e71 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.297797 Aug 01 14:13:10.515365 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 266/519] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:10 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:10.647220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.657843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.659336 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.661049 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-87890b60-b457-4178-8d84-d2680b376cc6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.174916 Aug 01 14:13:10.661649 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 254/520] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:10 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:10.829972 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9c3013bb-3c80-4107-bafa-c5aad88054be tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:10.830608 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9c3013bb-3c80-4107-bafa-c5aad88054be tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:10.837649 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c3013bb-3c80-4107-bafa-c5aad88054be tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.838099 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c3013bb-3c80-4107-bafa-c5aad88054be tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.838889 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c3013bb-3c80-4107-bafa-c5aad88054be tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.839344 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c3013bb-3c80-4107-bafa-c5aad88054be tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.909433 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9c3013bb-3c80-4107-bafa-c5aad88054be tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.917905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9c3013bb-3c80-4107-bafa-c5aad88054be tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1218 microversion: 2.1 time: 0.091876 Aug 01 14:13:10.918493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 267/521] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:10 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:11.507856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-765f1d7f-01f5-43dc-8e72-ff6e88fd64de tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:11.508510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-765f1d7f-01f5-43dc-8e72-ff6e88fd64de tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.515890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-765f1d7f-01f5-43dc-8e72-ff6e88fd64de tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.516361 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-765f1d7f-01f5-43dc-8e72-ff6e88fd64de tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.517129 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-765f1d7f-01f5-43dc-8e72-ff6e88fd64de tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.517557 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-765f1d7f-01f5-43dc-8e72-ff6e88fd64de tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.547540 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d8b2e6ed-06d8-417b-bad8-ec6347d2503f tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:11.548157 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d8b2e6ed-06d8-417b-bad8-ec6347d2503f tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.555503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d8b2e6ed-06d8-417b-bad8-ec6347d2503f tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.555919 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d8b2e6ed-06d8-417b-bad8-ec6347d2503f tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.556771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d8b2e6ed-06d8-417b-bad8-ec6347d2503f tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.557170 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d8b2e6ed-06d8-417b-bad8-ec6347d2503f tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.762518 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-765f1d7f-01f5-43dc-8e72-ff6e88fd64de tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:11.771475 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-765f1d7f-01f5-43dc-8e72-ff6e88fd64de tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1673 microversion: 2.1 time: 0.267658 Aug 01 14:13:11.772080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 255/522] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:11 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1673 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:11.783606 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:11.784334 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.791660 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.792397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.792976 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.793413 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.807910 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d8b2e6ed-06d8-417b-bad8-ec6347d2503f tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:11.810075 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=100 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:11.820966 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d8b2e6ed-06d8-417b-bad8-ec6347d2503f tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.287481 Aug 01 14:13:11.821805 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 268/523] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:11 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:11.939736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ba2ad06a-a0c9-4900-af1f-9bc7129bbc1e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:11.940806 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ba2ad06a-a0c9-4900-af1f-9bc7129bbc1e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.951813 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba2ad06a-a0c9-4900-af1f-9bc7129bbc1e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.952396 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba2ad06a-a0c9-4900-af1f-9bc7129bbc1e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.953052 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba2ad06a-a0c9-4900-af1f-9bc7129bbc1e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.953478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba2ad06a-a0c9-4900-af1f-9bc7129bbc1e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.956942 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:11.957538 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:11.971025 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:11.972945 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:11.975156 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3256939a-ac25-4a92-9342-362043754e22 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.195415 Aug 01 14:13:11.976503 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 256/524] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:11 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:12.023730 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ba2ad06a-a0c9-4900-af1f-9bc7129bbc1e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:12.031572 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ba2ad06a-a0c9-4900-af1f-9bc7129bbc1e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1218 microversion: 2.1 time: 0.097140 Aug 01 14:13:12.032173 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 269/525] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:11 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:12.793802 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ff2f9b1e-738c-4442-ae30-fae6573300a8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:12.794425 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ff2f9b1e-738c-4442-ae30-fae6573300a8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:12.801730 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ff2f9b1e-738c-4442-ae30-fae6573300a8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:12.802124 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ff2f9b1e-738c-4442-ae30-fae6573300a8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:12.802894 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ff2f9b1e-738c-4442-ae30-fae6573300a8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:12.803309 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ff2f9b1e-738c-4442-ae30-fae6573300a8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:12.855126 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cae149e5-0714-4e57-8829-e5a560c5fb87 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:12.855730 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cae149e5-0714-4e57-8829-e5a560c5fb87 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:12.862695 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cae149e5-0714-4e57-8829-e5a560c5fb87 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:12.863141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cae149e5-0714-4e57-8829-e5a560c5fb87 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:12.863898 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cae149e5-0714-4e57-8829-e5a560c5fb87 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:12.864337 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cae149e5-0714-4e57-8829-e5a560c5fb87 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:12.985400 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ff2f9b1e-738c-4442-ae30-fae6573300a8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:12.993490 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ff2f9b1e-738c-4442-ae30-fae6573300a8 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1673 microversion: 2.1 time: 0.203674 Aug 01 14:13:12.994145 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 257/526] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:12 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:12.999609 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:13.000640 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:13.007044 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:13.007480 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:13.008247 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:13.008694 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:13.065517 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cae149e5-0714-4e57-8829-e5a560c5fb87 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:13.074463 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cae149e5-0714-4e57-8829-e5a560c5fb87 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1753 microversion: 2.1 time: 0.223144 Aug 01 14:13:13.075392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 270/527] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:12 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:13.079986 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-562e43df-1cfa-4e94-9229-0c60ac1e4c14 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:13.080620 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-562e43df-1cfa-4e94-9229-0c60ac1e4c14 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:13.086924 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-562e43df-1cfa-4e94-9229-0c60ac1e4c14 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:13.087397 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-562e43df-1cfa-4e94-9229-0c60ac1e4c14 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:13.088170 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-562e43df-1cfa-4e94-9229-0c60ac1e4c14 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:13.088706 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-562e43df-1cfa-4e94-9229-0c60ac1e4c14 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:13.170693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-562e43df-1cfa-4e94-9229-0c60ac1e4c14 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:13.179864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-562e43df-1cfa-4e94-9229-0c60ac1e4c14 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1218 microversion: 2.1 time: 0.103338 Aug 01 14:13:13.180610 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 271/528] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:13 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:13.190824 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:13.200900 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:13.202410 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:13.203579 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a7e33509-d4b2-4b93-bda3-87ad163f8892 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.207924 Aug 01 14:13:13.204149 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 258/529] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:12 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:14.015453 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-39f319d7-6716-4398-9a97-a4f9911ad969 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:14.016140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-39f319d7-6716-4398-9a97-a4f9911ad969 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:14.023640 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39f319d7-6716-4398-9a97-a4f9911ad969 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.024082 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39f319d7-6716-4398-9a97-a4f9911ad969 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.024901 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39f319d7-6716-4398-9a97-a4f9911ad969 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.025330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39f319d7-6716-4398-9a97-a4f9911ad969 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.096466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1320eebf-7c5e-4d37-9eb3-dec0f8d46273 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:14.097014 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1320eebf-7c5e-4d37-9eb3-dec0f8d46273 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:14.107150 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1320eebf-7c5e-4d37-9eb3-dec0f8d46273 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.107598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1320eebf-7c5e-4d37-9eb3-dec0f8d46273 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.108654 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1320eebf-7c5e-4d37-9eb3-dec0f8d46273 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.109326 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1320eebf-7c5e-4d37-9eb3-dec0f8d46273 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.206838 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-39f319d7-6716-4398-9a97-a4f9911ad969 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.217658 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-39f319d7-6716-4398-9a97-a4f9911ad969 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1673 microversion: 2.1 time: 0.205832 Aug 01 14:13:14.218671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 272/530] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:14 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:14.234681 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-71bc1074-9c58-4628-96bf-010cf2613cda tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:14.235523 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-71bc1074-9c58-4628-96bf-010cf2613cda tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:14.244635 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71bc1074-9c58-4628-96bf-010cf2613cda tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.245382 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71bc1074-9c58-4628-96bf-010cf2613cda tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.246751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71bc1074-9c58-4628-96bf-010cf2613cda tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.247510 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71bc1074-9c58-4628-96bf-010cf2613cda tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.340770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-71bc1074-9c58-4628-96bf-010cf2613cda tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.347365 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1320eebf-7c5e-4d37-9eb3-dec0f8d46273 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.349641 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-71bc1074-9c58-4628-96bf-010cf2613cda tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1210 microversion: 2.1 time: 0.129539 Aug 01 14:13:14.350594 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 273/531] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:14 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1210 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:14.355236 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:14.355840 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:14.360071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1320eebf-7c5e-4d37-9eb3-dec0f8d46273 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1756 microversion: 2.1 time: 0.267319 Aug 01 14:13:14.361059 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 259/532] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:14 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1756 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:14.364565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.365375 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.366536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.367412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.518427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.529509 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.531010 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.532191 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7e2a9fb2-6acc-40e4-b5bc-288c05d74046 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.180885 Aug 01 14:13:14.532789 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 274/533] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:14 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:15.248839 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c83b61c1-f171-43bb-8051-cb42759fb3a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:15.249982 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c83b61c1-f171-43bb-8051-cb42759fb3a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:15.258509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c83b61c1-f171-43bb-8051-cb42759fb3a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.258961 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c83b61c1-f171-43bb-8051-cb42759fb3a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.259737 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c83b61c1-f171-43bb-8051-cb42759fb3a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.260174 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c83b61c1-f171-43bb-8051-cb42759fb3a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.340422 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:15.375227 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d332094b-7ab3-4485-9b8b-a9b9ac75e98f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:15.376313 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d332094b-7ab3-4485-9b8b-a9b9ac75e98f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:15.379039 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:15.379862 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:15.386106 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d332094b-7ab3-4485-9b8b-a9b9ac75e98f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.386548 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d332094b-7ab3-4485-9b8b-a9b9ac75e98f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.387316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d332094b-7ab3-4485-9b8b-a9b9ac75e98f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.387741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d332094b-7ab3-4485-9b8b-a9b9ac75e98f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.430545 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c83b61c1-f171-43bb-8051-cb42759fb3a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:15.438922 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c83b61c1-f171-43bb-8051-cb42759fb3a5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1673 microversion: 2.1 time: 0.195646 Aug 01 14:13:15.439532 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 260/534] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:15 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1673 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:15.460257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d332094b-7ab3-4485-9b8b-a9b9ac75e98f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:15.468616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d332094b-7ab3-4485-9b8b-a9b9ac75e98f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1210 microversion: 2.1 time: 0.097590 Aug 01 14:13:15.469200 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 275/535] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:15 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:15.573927 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:15.574738 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:15.581407 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.581857 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.582712 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.583143 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.727237 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:15.737653 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:15.739449 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:15.740937 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3e43dfd5-e7f4-446c-a7c1-a1ff808e7a08 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.171883 Aug 01 14:13:15.741511 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 261/536] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:15 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:16.480967 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a9ef92ae-97bc-4e43-894f-41acde45ab69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:16.482408 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a9ef92ae-97bc-4e43-894f-41acde45ab69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:16.491129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9ef92ae-97bc-4e43-894f-41acde45ab69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.491651 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9ef92ae-97bc-4e43-894f-41acde45ab69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.492492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9ef92ae-97bc-4e43-894f-41acde45ab69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.492928 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9ef92ae-97bc-4e43-894f-41acde45ab69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.494228 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-60ed3e8b-0286-4afa-9a01-1e2049c6e655 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:16.503179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-60ed3e8b-0286-4afa-9a01-1e2049c6e655 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:16.514323 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-60ed3e8b-0286-4afa-9a01-1e2049c6e655 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.520791 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-60ed3e8b-0286-4afa-9a01-1e2049c6e655 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.524310 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-60ed3e8b-0286-4afa-9a01-1e2049c6e655 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.525418 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-60ed3e8b-0286-4afa-9a01-1e2049c6e655 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.636983 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-60ed3e8b-0286-4afa-9a01-1e2049c6e655 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:16.649268 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-60ed3e8b-0286-4afa-9a01-1e2049c6e655 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1272 microversion: 2.1 time: 0.159190 Aug 01 14:13:16.650168 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 262/537] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:16 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:16.656056 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5b1fe29e-744e-4130-9e75-6da9c3ba6f50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:16.658444 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5b1fe29e-744e-4130-9e75-6da9c3ba6f50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:16.666764 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5b1fe29e-744e-4130-9e75-6da9c3ba6f50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.666990 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5b1fe29e-744e-4130-9e75-6da9c3ba6f50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.667585 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5b1fe29e-744e-4130-9e75-6da9c3ba6f50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.668307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5b1fe29e-744e-4130-9e75-6da9c3ba6f50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.694087 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-5b1fe29e-744e-4130-9e75-6da9c3ba6f50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lazy-loading 'flavor' on Instance uuid b69e5d2d-0483-4373-aa71-ea2305f287d3 {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:13:16.853022 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5b1fe29e-744e-4130-9e75-6da9c3ba6f50 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/action" status: 200 len: 32 microversion: 2.1 time: 0.200788 Aug 01 14:13:16.853995 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 263/538] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:13:16 2022] POST /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:13:16.860609 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:16.861523 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:16.868919 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.869439 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.870272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.870700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.175442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a9ef92ae-97bc-4e43-894f-41acde45ab69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:17.187435 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a9ef92ae-97bc-4e43-894f-41acde45ab69 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1673 microversion: 2.1 time: 0.729943 Aug 01 14:13:17.188151 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 276/539] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:16 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1673 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:17.193022 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e67adcc7-e6e7-4daf-8f22-a1a79d6bcad2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:17.193921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e67adcc7-e6e7-4daf-8f22-a1a79d6bcad2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:17.201381 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e67adcc7-e6e7-4daf-8f22-a1a79d6bcad2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.202191 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e67adcc7-e6e7-4daf-8f22-a1a79d6bcad2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.203219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e67adcc7-e6e7-4daf-8f22-a1a79d6bcad2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.203874 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e67adcc7-e6e7-4daf-8f22-a1a79d6bcad2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.265395 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:17.278801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:17.281078 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:17.283644 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6ab2b9ed-a40c-4702-bd31-c3bc09f7c995 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.427818 Aug 01 14:13:17.284936 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 264/540] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:16 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:17.500982 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e67adcc7-e6e7-4daf-8f22-a1a79d6bcad2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:17.510625 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e67adcc7-e6e7-4daf-8f22-a1a79d6bcad2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.321257 Aug 01 14:13:17.511227 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 277/541] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:17 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:17.671687 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-034ff352-d4fb-4dca-8b78-3f61a572c12f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:17.672851 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-034ff352-d4fb-4dca-8b78-3f61a572c12f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:17.684163 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-034ff352-d4fb-4dca-8b78-3f61a572c12f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.684988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-034ff352-d4fb-4dca-8b78-3f61a572c12f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.686143 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-034ff352-d4fb-4dca-8b78-3f61a572c12f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.686850 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-034ff352-d4fb-4dca-8b78-3f61a572c12f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.738426 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-ddbf12ad-5e0a-4ad9-944d-9a185d313393 req-efbef6e6-d425-4f59-ab74-8c427340155d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8", "name": "network-vif-deleted", "tag": "82f43520-38c1-414e-b0a4-66b27e6ff60b"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:17.782695 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ddbf12ad-5e0a-4ad9-944d-9a185d313393 req-efbef6e6-d425-4f59-ab74-8c427340155d service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.783129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ddbf12ad-5e0a-4ad9-944d-9a185d313393 req-efbef6e6-d425-4f59-ab74-8c427340155d service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.808330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-ddbf12ad-5e0a-4ad9-944d-9a185d313393 req-efbef6e6-d425-4f59-ab74-8c427340155d service nova] Creating event network-vif-deleted:82f43520-38c1-414e-b0a4-66b27e6ff60b for instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 on hv-cinder-84517 Aug 01 14:13:17.826655 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-ddbf12ad-5e0a-4ad9-944d-9a185d313393 req-efbef6e6-d425-4f59-ab74-8c427340155d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092761 Aug 01 14:13:17.839448 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 278/542] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:17.857458 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-034ff352-d4fb-4dca-8b78-3f61a572c12f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:17.876086 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-034ff352-d4fb-4dca-8b78-3f61a572c12f tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1272 microversion: 2.1 time: 0.201945 Aug 01 14:13:17.882041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 265/543] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:17 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:18.212998 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:18.213831 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:18.221934 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:18.223708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:18.224750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:18.225356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:18.306910 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:18.307573 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:18.313734 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:18.315002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lazy-loading 'fault' on Instance uuid 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:13:18.315142 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:18.349323 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:18.349803 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:18.351662 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:18.352574 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:18.729168 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:18.742380 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:18.745426 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:18.747011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8d505bc4-a9b4-4fb3-b5a3-5b6a01ae526c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.442679 Aug 01 14:13:18.748924 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 266/544] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:18 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:18.758331 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3ac776e4-3a7f-4a99-84ae-fe7ef9585fb2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:18.759259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3ac776e4-3a7f-4a99-84ae-fe7ef9585fb2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:18.770979 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3ac776e4-3a7f-4a99-84ae-fe7ef9585fb2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:18.771717 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3ac776e4-3a7f-4a99-84ae-fe7ef9585fb2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:18.772777 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3ac776e4-3a7f-4a99-84ae-fe7ef9585fb2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:18.773408 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3ac776e4-3a7f-4a99-84ae-fe7ef9585fb2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:18.775555 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:18.792496 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-06b1d230-f141-4087-9408-8c8c06b9f84d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 200 len: 1327 microversion: 2.1 time: 0.579707 Aug 01 14:13:18.793758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 279/545] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:18 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 1327 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:18.903180 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d5b59987-0a1b-428f-bd28-cdd8087a64b1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:18.905724 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d5b59987-0a1b-428f-bd28-cdd8087a64b1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:18.913720 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d5b59987-0a1b-428f-bd28-cdd8087a64b1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:18.914593 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d5b59987-0a1b-428f-bd28-cdd8087a64b1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:18.915564 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d5b59987-0a1b-428f-bd28-cdd8087a64b1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:18.916142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d5b59987-0a1b-428f-bd28-cdd8087a64b1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.233772 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d5b59987-0a1b-428f-bd28-cdd8087a64b1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:19.244123 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d5b59987-0a1b-428f-bd28-cdd8087a64b1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1314 microversion: 2.1 time: 0.344775 Aug 01 14:13:19.245128 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 280/546] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:18 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:19.262483 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3ac776e4-3a7f-4a99-84ae-fe7ef9585fb2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:19.271499 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3ac776e4-3a7f-4a99-84ae-fe7ef9585fb2 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.521088 Aug 01 14:13:19.272101 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 267/547] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:18 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:19.773716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:19.774444 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:19.782317 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:19.783360 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.783753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:19.784484 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.815553 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:19.818378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:19.826391 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:19.826997 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.828034 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:19.828562 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.846717 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] HTTP exception thrown: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Request method failure captured: Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 HTTP/1.1 Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi595aE0N9koR2Ter1AhuZogg1ECqfLPydJ7SJ0uq8BUPhXsAvnVMfZrK9CmkmC0mIepUkUyQsoqAFfo198EyedsYToTaER2Z4Rt5jfAd-IemVRy2qhroPtXKVQWx5UlhSz9Ps_QOz9D6x4h1J-tEqPf6JD7egENjQ3rh0cd7MOT18jYQ Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:13:19.849351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1081ae5fd3e9443c80626517ae9c7d77", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1081ae5fd3e9443c80626517ae9c7d77"}]}] Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 87f35e960544403ea30ba36d878a86cb Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:13:19.850897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8'} Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:19.851726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:13:19.852986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:19.856978 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Returning 404 to user: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:19.858443 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-db1d78b7-2954-46a2-8c38-25bc82aac41b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 404 len: 111 microversion: 2.1 time: 0.047777 Aug 01 14:13:19.859930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 268/548] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:19 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:13:19.869622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3acd2117-ce31-4c6c-8184-b56cc35646f6 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '.version_select at 0x7fc579701e50>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:19.902747 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3acd2117-ce31-4c6c-8184-b56cc35646f6 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078354145" status: 202 len: 0 microversion: 2.1 time: 0.038421 Aug 01 14:13:19.907126 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 269/549] 10.222.0.45 () {58 vars in 1221 bytes} [Mon Aug 1 14:13:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078354145 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:13:19.914948 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-29e39917-6913-40ad-a6d3-26d27618c5c6 req-35cc9d1e-5781-4a70-ad20-35cb1c585960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9f2f1f-04ca-4496-84f1-6d78dba974ae", "tag": "5ac98040-b7c0-45ff-8416-201d90575263"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:19.934404 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-29e39917-6913-40ad-a6d3-26d27618c5c6 req-35cc9d1e-5781-4a70-ad20-35cb1c585960 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:19.934854 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-29e39917-6913-40ad-a6d3-26d27618c5c6 req-35cc9d1e-5781-4a70-ad20-35cb1c585960 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.958485 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-29e39917-6913-40ad-a6d3-26d27618c5c6 req-35cc9d1e-5781-4a70-ad20-35cb1c585960 service nova] Creating event network-changed:5ac98040-b7c0-45ff-8416-201d90575263 for instance 3b9f2f1f-04ca-4496-84f1-6d78dba974ae on hv-cinder-84517 Aug 01 14:13:19.977391 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-29e39917-6913-40ad-a6d3-26d27618c5c6 req-35cc9d1e-5781-4a70-ad20-35cb1c585960 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071167 Aug 01 14:13:19.986040 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 270/550] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:20.056185 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:20.087319 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:20.088665 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-fd0e373d-4ec1-4f36-b97c-842bfce752c5 req-66c08c47-02c2-418d-91bf-2160d1154cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446cfa38-0982-47b2-8e3f-a44a35257447", "name": "network-vif-plugged", "status": "completed", "tag": "3c265e4a-7314-4d99-a248-2eb055ab90c0"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:20.091921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:20.095933 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1bb89edf-1f28-4ef2-b8f1-41f5fd354fb5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.326377 Aug 01 14:13:20.096782 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 281/551] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:19 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:20.117758 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-fd0e373d-4ec1-4f36-b97c-842bfce752c5 req-66c08c47-02c2-418d-91bf-2160d1154cf9 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:20.118205 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-fd0e373d-4ec1-4f36-b97c-842bfce752c5 req-66c08c47-02c2-418d-91bf-2160d1154cf9 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:20.135168 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-fd0e373d-4ec1-4f36-b97c-842bfce752c5 req-66c08c47-02c2-418d-91bf-2160d1154cf9 service nova] Creating event network-vif-plugged:3c265e4a-7314-4d99-a248-2eb055ab90c0 for instance 446cfa38-0982-47b2-8e3f-a44a35257447 on hv-cinder-84517 Aug 01 14:13:20.149178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-fd0e373d-4ec1-4f36-b97c-842bfce752c5 req-66c08c47-02c2-418d-91bf-2160d1154cf9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066896 Aug 01 14:13:20.150307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 271/552] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:20.266587 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ed1ed899-19c6-4dc5-8aa6-41f0df1b0051 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:20.267381 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ed1ed899-19c6-4dc5-8aa6-41f0df1b0051 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:20.283329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ed1ed899-19c6-4dc5-8aa6-41f0df1b0051 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:20.283329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ed1ed899-19c6-4dc5-8aa6-41f0df1b0051 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:20.283329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ed1ed899-19c6-4dc5-8aa6-41f0df1b0051 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:20.283329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ed1ed899-19c6-4dc5-8aa6-41f0df1b0051 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:20.294305 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-768a5158-7870-4be2-88b1-d51317df2317 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:20.295018 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-768a5158-7870-4be2-88b1-d51317df2317 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:20.302090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-768a5158-7870-4be2-88b1-d51317df2317 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:20.302538 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-768a5158-7870-4be2-88b1-d51317df2317 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:20.303320 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-768a5158-7870-4be2-88b1-d51317df2317 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:20.303755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-768a5158-7870-4be2-88b1-d51317df2317 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:20.514705 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ed1ed899-19c6-4dc5-8aa6-41f0df1b0051 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:20.522237 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-768a5158-7870-4be2-88b1-d51317df2317 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:20.529873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ed1ed899-19c6-4dc5-8aa6-41f0df1b0051 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1314 microversion: 2.1 time: 0.267126 Aug 01 14:13:20.531066 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 282/553] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:20 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:20.531416 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-768a5158-7870-4be2-88b1-d51317df2317 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.241293 Aug 01 14:13:20.537614 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 272/554] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:20 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:20.836130 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ea048288-4697-424b-8cc7-2fe35d346a9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'create', calling method: .version_select at 0x7fc5797bff70>, body: {"keypair": {"name": "tempest-keypair-659956227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2jYYcOJ0zWI7fWc8XCWcWx5sq3PPz8Kze3cnpy34uf3V3LIEB3lqE23Lcgco9kbUMYHhQtFWdZEckybSjSaUv2FC0VE5peXbII0E2ipWMvSufGGVRN2I2bJvvO4JufaA=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:20.855705 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-ea048288-4697-424b-8cc7-2fe35d346a9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Getting quotas for project 1081ae5fd3e9443c80626517ae9c7d77. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:13:20.859599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-ea048288-4697-424b-8cc7-2fe35d346a9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Getting quotas for user 87f35e960544403ea30ba36d878a86cb and project 1081ae5fd3e9443c80626517ae9c7d77. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:13:20.882504 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ea048288-4697-424b-8cc7-2fe35d346a9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050858 Aug 01 14:13:20.883149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 283/555] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:13:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:21.119322 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:21.120221 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:21.126933 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.127595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.128419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.128843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.297172 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:21.306988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:21.308738 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:21.310094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8139e1a7-9a52-43ea-9908-a959c90e0eee tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.194734 Aug 01 14:13:21.310675 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 273/556] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:21 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:21.556124 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4211fbd3-1ee3-4fa4-8b73-c50dd8b2bb56 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:21.556813 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7f2aa0d1-959a-4410-a5ed-a32a32ee9ed0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:21.557289 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4211fbd3-1ee3-4fa4-8b73-c50dd8b2bb56 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:21.563309 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7f2aa0d1-959a-4410-a5ed-a32a32ee9ed0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:21.566910 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4211fbd3-1ee3-4fa4-8b73-c50dd8b2bb56 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.567589 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4211fbd3-1ee3-4fa4-8b73-c50dd8b2bb56 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.568649 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4211fbd3-1ee3-4fa4-8b73-c50dd8b2bb56 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.569273 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4211fbd3-1ee3-4fa4-8b73-c50dd8b2bb56 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.572873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7f2aa0d1-959a-4410-a5ed-a32a32ee9ed0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.573551 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7f2aa0d1-959a-4410-a5ed-a32a32ee9ed0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.574768 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7f2aa0d1-959a-4410-a5ed-a32a32ee9ed0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.575398 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7f2aa0d1-959a-4410-a5ed-a32a32ee9ed0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.590503 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:21.787285 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7f2aa0d1-959a-4410-a5ed-a32a32ee9ed0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:21.797006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7f2aa0d1-959a-4410-a5ed-a32a32ee9ed0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1314 microversion: 2.1 time: 0.246513 Aug 01 14:13:21.797595 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 284/557] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:21 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:21.800085 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4211fbd3-1ee3-4fa4-8b73-c50dd8b2bb56 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:21.811402 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4211fbd3-1ee3-4fa4-8b73-c50dd8b2bb56 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.259210 Aug 01 14:13:21.812186 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 274/558] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:21 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:22.334712 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:22.336088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:22.343484 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:22.344020 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:22.345031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:22.345642 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:22.548373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:22.557334 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:22.559060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:22.560498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0410beee-38cd-41c5-bc9c-b604a2bcbf7e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.229842 Aug 01 14:13:22.561156 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 285/559] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:22 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:22.614712 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1650095469", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1aca417-45fc-4b60-8100-7ab851d89316"}], "security_groups": [{"name": "tempest-securitygroup--425267917"}], "key_name": "tempest-keypair-659956227", "user_data": "}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:22.728926 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] validate_networks() for [('c1aca417-45fc-4b60-8100-7ab851d89316', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:13:22.819129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f8e0416d-f32b-4ed3-bb03-c562e4919a02 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:22.819814 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f8e0416d-f32b-4ed3-bb03-c562e4919a02 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:22.826717 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f8e0416d-f32b-4ed3-bb03-c562e4919a02 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:22.827346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f8e0416d-f32b-4ed3-bb03-c562e4919a02 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:22.828494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f8e0416d-f32b-4ed3-bb03-c562e4919a02 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:22.829185 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f8e0416d-f32b-4ed3-bb03-c562e4919a02 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.170360 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f8e0416d-f32b-4ed3-bb03-c562e4919a02 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:23.178644 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f8e0416d-f32b-4ed3-bb03-c562e4919a02 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1314 microversion: 2.1 time: 0.363598 Aug 01 14:13:23.179350 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 286/560] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:22 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:23.187602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-de580b1c-6716-4b77-8263-d6346d4fefe7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:23.188561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-de580b1c-6716-4b77-8263-d6346d4fefe7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:23.191018 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:23.197583 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de580b1c-6716-4b77-8263-d6346d4fefe7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.198028 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de580b1c-6716-4b77-8263-d6346d4fefe7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.198860 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de580b1c-6716-4b77-8263-d6346d4fefe7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.199337 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de580b1c-6716-4b77-8263-d6346d4fefe7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.204775 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:23.730488 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:13:23.731596 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:13:23.732080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:13:23.732691 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:13:23.732960 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:13:23.733555 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-de580b1c-6716-4b77-8263-d6346d4fefe7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:23.741695 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-de580b1c-6716-4b77-8263-d6346d4fefe7 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.561017 Aug 01 14:13:23.742274 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 287/561] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:23 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:23.743186 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.743643 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.744767 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.745206 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.746998 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:23.747635 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:23.753800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.754241 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.755130 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.760037 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.765378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Getting quotas for project 1081ae5fd3e9443c80626517ae9c7d77. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:13:23.770688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Getting quotas for user 87f35e960544403ea30ba36d878a86cb and project 1081ae5fd3e9443c80626517ae9c7d77. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:13:23.783117 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:13:23.785865 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:13:23.837347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0ac1a565-244a-45ef-b827-c16f6b6f28c5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.227784 Aug 01 14:13:23.847737 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 275/562] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:13:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:13:23.856715 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-939bab5b-a5ed-4ed7-8f27-b364bd00a2b9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:23.857347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-939bab5b-a5ed-4ed7-8f27-b364bd00a2b9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:23.987010 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-939bab5b-a5ed-4ed7-8f27-b364bd00a2b9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:23.996428 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-939bab5b-a5ed-4ed7-8f27-b364bd00a2b9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1237 microversion: 2.1 time: 0.147090 Aug 01 14:13:23.997888 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 276/563] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:23 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1237 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:24.015020 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:24.028345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:24.030873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:24.032325 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c7865216-2617-4f73-a9a8-23e783f2590c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.289095 Aug 01 14:13:24.033380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 288/564] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:23 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:24.205238 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bcf4a53d-0cc3-4489-9619-c1cf89f1892c tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:24.205866 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bcf4a53d-0cc3-4489-9619-c1cf89f1892c tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:24.216447 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bcf4a53d-0cc3-4489-9619-c1cf89f1892c tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:24.216955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bcf4a53d-0cc3-4489-9619-c1cf89f1892c tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:24.218142 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bcf4a53d-0cc3-4489-9619-c1cf89f1892c tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:24.218768 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bcf4a53d-0cc3-4489-9619-c1cf89f1892c tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:24.408301 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bcf4a53d-0cc3-4489-9619-c1cf89f1892c tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:24.417672 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bcf4a53d-0cc3-4489-9619-c1cf89f1892c tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1314 microversion: 2.1 time: 0.219901 Aug 01 14:13:24.418271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 277/565] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:24 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:24.764744 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1519b7cd-8acb-4ef2-b533-c2f6b354dd68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:24.765402 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1519b7cd-8acb-4ef2-b533-c2f6b354dd68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:24.772724 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1519b7cd-8acb-4ef2-b533-c2f6b354dd68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:24.773196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1519b7cd-8acb-4ef2-b533-c2f6b354dd68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:24.773972 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1519b7cd-8acb-4ef2-b533-c2f6b354dd68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:24.774408 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1519b7cd-8acb-4ef2-b533-c2f6b354dd68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:24.921631 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1519b7cd-8acb-4ef2-b533-c2f6b354dd68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:24.928703 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1519b7cd-8acb-4ef2-b533-c2f6b354dd68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.169149 Aug 01 14:13:24.929616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 289/566] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:24 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:25.018461 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0223207a-d297-43b6-9811-174ab1fad141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:25.019087 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0223207a-d297-43b6-9811-174ab1fad141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:25.027964 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0223207a-d297-43b6-9811-174ab1fad141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.028465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0223207a-d297-43b6-9811-174ab1fad141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.029311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0223207a-d297-43b6-9811-174ab1fad141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.029789 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0223207a-d297-43b6-9811-174ab1fad141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.058050 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:25.059051 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:25.072616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.073391 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.074353 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.075016 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.148351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0223207a-d297-43b6-9811-174ab1fad141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:25.165209 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0223207a-d297-43b6-9811-174ab1fad141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1289 microversion: 2.1 time: 0.150378 Aug 01 14:13:25.166765 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 278/567] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:25 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:25.407209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:25.417961 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:25.420188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:25.421437 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ecea5886-eda0-475b-b0df-d745c1f753a6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1810 microversion: 2.20 time: 0.367671 Aug 01 14:13:25.421977 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 290/568] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:25 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1810 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:25.439013 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-cfd6a36e-7705-428a-83d3-ebcdbe8a49e1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:25.439672 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-cfd6a36e-7705-428a-83d3-ebcdbe8a49e1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:25.441665 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:25.447533 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cfd6a36e-7705-428a-83d3-ebcdbe8a49e1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.447977 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cfd6a36e-7705-428a-83d3-ebcdbe8a49e1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.448791 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cfd6a36e-7705-428a-83d3-ebcdbe8a49e1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.449216 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cfd6a36e-7705-428a-83d3-ebcdbe8a49e1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.759585 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-cfd6a36e-7705-428a-83d3-ebcdbe8a49e1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:25.767978 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-cfd6a36e-7705-428a-83d3-ebcdbe8a49e1 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1314 microversion: 2.1 time: 0.332855 Aug 01 14:13:25.768626 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 279/569] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:25 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:25.952055 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-50c8a92c-7abb-4f0a-85fe-e162e64e0e8e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:25.953016 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-50c8a92c-7abb-4f0a-85fe-e162e64e0e8e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:25.960853 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-50c8a92c-7abb-4f0a-85fe-e162e64e0e8e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.961682 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-50c8a92c-7abb-4f0a-85fe-e162e64e0e8e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.962601 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-50c8a92c-7abb-4f0a-85fe-e162e64e0e8e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.963255 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-50c8a92c-7abb-4f0a-85fe-e162e64e0e8e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.078902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-d5e04840-140a-4bd3-9b99-7f64f5e0d51e req-ae4814e2-951b-495d-bf28-f227c955182d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f2f1f-04ca-4496-84f1-6d78dba974ae", "name": "network-vif-plugged", "status": "completed", "tag": "5ac98040-b7c0-45ff-8416-201d90575263"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:26.094927 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-d5e04840-140a-4bd3-9b99-7f64f5e0d51e req-ae4814e2-951b-495d-bf28-f227c955182d service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.095371 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-d5e04840-140a-4bd3-9b99-7f64f5e0d51e req-ae4814e2-951b-495d-bf28-f227c955182d service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.115577 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-d5e04840-140a-4bd3-9b99-7f64f5e0d51e req-ae4814e2-951b-495d-bf28-f227c955182d service nova] Creating event network-vif-plugged:5ac98040-b7c0-45ff-8416-201d90575263 for instance 3b9f2f1f-04ca-4496-84f1-6d78dba974ae on hv-cinder-84517 Aug 01 14:13:26.121163 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-d5e04840-140a-4bd3-9b99-7f64f5e0d51e req-ae4814e2-951b-495d-bf28-f227c955182d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047245 Aug 01 14:13:26.122533 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 280/570] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:26.271446 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-50c8a92c-7abb-4f0a-85fe-e162e64e0e8e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.272174 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-442d8b87-2715-4973-a8b3-7cc1ccc7bf5b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:26.272961 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-442d8b87-2715-4973-a8b3-7cc1ccc7bf5b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:26.280424 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-442d8b87-2715-4973-a8b3-7cc1ccc7bf5b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.281328 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-442d8b87-2715-4973-a8b3-7cc1ccc7bf5b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.281458 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-50c8a92c-7abb-4f0a-85fe-e162e64e0e8e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.334035 Aug 01 14:13:26.282414 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-442d8b87-2715-4973-a8b3-7cc1ccc7bf5b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.283002 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-442d8b87-2715-4973-a8b3-7cc1ccc7bf5b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.295979 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 291/571] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:25 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:26.400904 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-442d8b87-2715-4973-a8b3-7cc1ccc7bf5b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.411429 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-442d8b87-2715-4973-a8b3-7cc1ccc7bf5b tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1295 microversion: 2.1 time: 0.221548 Aug 01 14:13:26.412786 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 281/572] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:26 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1295 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:26.445755 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:26.447444 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:26.453872 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.454308 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.455130 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.455757 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.656442 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.666614 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.668162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.669405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eead4fe8-c343-4477-aa14-9563cc3bf2ba tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1797 microversion: 2.20 time: 0.227830 Aug 01 14:13:26.684551 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 292/573] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:26 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1797 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:26.791344 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1b603ab6-ebca-4109-bc2e-08c1129298b0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:26.791941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1b603ab6-ebca-4109-bc2e-08c1129298b0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:26.798457 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1b603ab6-ebca-4109-bc2e-08c1129298b0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.798906 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1b603ab6-ebca-4109-bc2e-08c1129298b0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.799703 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1b603ab6-ebca-4109-bc2e-08c1129298b0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.800140 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1b603ab6-ebca-4109-bc2e-08c1129298b0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.952733 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1b603ab6-ebca-4109-bc2e-08c1129298b0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.961007 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1b603ab6-ebca-4109-bc2e-08c1129298b0 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1314 microversion: 2.1 time: 0.173735 Aug 01 14:13:26.961626 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 282/574] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:26 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:27.306399 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-109a1e67-75bd-4ec1-a2a1-a1404729a732 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:27.307392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-109a1e67-75bd-4ec1-a2a1-a1404729a732 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:27.317659 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-109a1e67-75bd-4ec1-a2a1-a1404729a732 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:27.318098 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-109a1e67-75bd-4ec1-a2a1-a1404729a732 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:27.318897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-109a1e67-75bd-4ec1-a2a1-a1404729a732 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:27.319332 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-109a1e67-75bd-4ec1-a2a1-a1404729a732 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:27.436849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d15698ca-16a8-47d3-b03d-143b5d879d17 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:27.437570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d15698ca-16a8-47d3-b03d-143b5d879d17 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:27.445215 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d15698ca-16a8-47d3-b03d-143b5d879d17 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:27.445649 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d15698ca-16a8-47d3-b03d-143b5d879d17 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:27.446446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d15698ca-16a8-47d3-b03d-143b5d879d17 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:27.446903 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d15698ca-16a8-47d3-b03d-143b5d879d17 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:27.543337 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-109a1e67-75bd-4ec1-a2a1-a1404729a732 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:27.563587 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-109a1e67-75bd-4ec1-a2a1-a1404729a732 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.261435 Aug 01 14:13:27.565565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 293/575] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:27 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:27.762297 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d15698ca-16a8-47d3-b03d-143b5d879d17 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:27.770384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d15698ca-16a8-47d3-b03d-143b5d879d17 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1362 microversion: 2.1 time: 0.337667 Aug 01 14:13:27.771245 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 283/576] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:27 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:27.986837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-85453a70-b372-47fe-adc1-a8d224940cbd tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:27.990645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-85453a70-b372-47fe-adc1-a8d224940cbd tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:27.994982 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85453a70-b372-47fe-adc1-a8d224940cbd tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:27.995587 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85453a70-b372-47fe-adc1-a8d224940cbd tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:27.999729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85453a70-b372-47fe-adc1-a8d224940cbd tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.008748 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85453a70-b372-47fe-adc1-a8d224940cbd tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.267386 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-85453a70-b372-47fe-adc1-a8d224940cbd tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:28.276302 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-85453a70-b372-47fe-adc1-a8d224940cbd tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1314 microversion: 2.1 time: 0.293245 Aug 01 14:13:28.277048 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 294/577] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:27 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:28.353605 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-11ce9c8b-bc15-488b-bc0d-adc667bd05cf req-04a0a0a6-3777-4f0e-8216-4be0a563de83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462a7ad5-816c-49b1-a36b-84dc587c93ca", "tag": "41238094-cf08-4cf7-b716-88a929b830bb"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:28.364562 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-11ce9c8b-bc15-488b-bc0d-adc667bd05cf req-04a0a0a6-3777-4f0e-8216-4be0a563de83 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.364562 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-11ce9c8b-bc15-488b-bc0d-adc667bd05cf req-04a0a0a6-3777-4f0e-8216-4be0a563de83 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.377917 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-11ce9c8b-bc15-488b-bc0d-adc667bd05cf req-04a0a0a6-3777-4f0e-8216-4be0a563de83 service nova] Creating event network-changed:41238094-cf08-4cf7-b716-88a929b830bb for instance 462a7ad5-816c-49b1-a36b-84dc587c93ca on hv-cinder-84517 Aug 01 14:13:28.383195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-11ce9c8b-bc15-488b-bc0d-adc667bd05cf req-04a0a0a6-3777-4f0e-8216-4be0a563de83 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034413 Aug 01 14:13:28.383821 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 284/578] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:28.587082 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-556af689-94a5-4812-973d-89639fc1e5d5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:28.588023 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-556af689-94a5-4812-973d-89639fc1e5d5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:28.597697 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-556af689-94a5-4812-973d-89639fc1e5d5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.598234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-556af689-94a5-4812-973d-89639fc1e5d5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.599057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-556af689-94a5-4812-973d-89639fc1e5d5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.599554 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-556af689-94a5-4812-973d-89639fc1e5d5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.793516 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bb73cf01-d0b3-4324-9beb-81bc1be55926 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:28.794426 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bb73cf01-d0b3-4324-9beb-81bc1be55926 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:28.802141 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bb73cf01-d0b3-4324-9beb-81bc1be55926 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.802489 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bb73cf01-d0b3-4324-9beb-81bc1be55926 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.803364 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bb73cf01-d0b3-4324-9beb-81bc1be55926 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.803873 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bb73cf01-d0b3-4324-9beb-81bc1be55926 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.830325 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-556af689-94a5-4812-973d-89639fc1e5d5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:28.839715 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-556af689-94a5-4812-973d-89639fc1e5d5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.256445 Aug 01 14:13:28.840398 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 295/579] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:28 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:29.037312 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bb73cf01-d0b3-4324-9beb-81bc1be55926 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:29.045230 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bb73cf01-d0b3-4324-9beb-81bc1be55926 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1362 microversion: 2.1 time: 0.256045 Aug 01 14:13:29.045968 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 285/580] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:28 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:29.297432 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8f6589d1-c0f8-4549-b111-b7cdbdc48b60 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:29.298036 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8f6589d1-c0f8-4549-b111-b7cdbdc48b60 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:29.304780 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f6589d1-c0f8-4549-b111-b7cdbdc48b60 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.305217 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f6589d1-c0f8-4549-b111-b7cdbdc48b60 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.305973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f6589d1-c0f8-4549-b111-b7cdbdc48b60 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.306392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f6589d1-c0f8-4549-b111-b7cdbdc48b60 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.524057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8f6589d1-c0f8-4549-b111-b7cdbdc48b60 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:29.532915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8f6589d1-c0f8-4549-b111-b7cdbdc48b60 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1464 microversion: 2.1 time: 0.239378 Aug 01 14:13:29.533860 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 296/581] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:29 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1464 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:29.589218 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c89fe523-da8a-49af-9ca5-bbdebcf2cf52 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:29.589691 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c89fe523-da8a-49af-9ca5-bbdebcf2cf52 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:29.596531 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c89fe523-da8a-49af-9ca5-bbdebcf2cf52 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.596874 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c89fe523-da8a-49af-9ca5-bbdebcf2cf52 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.597648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c89fe523-da8a-49af-9ca5-bbdebcf2cf52 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.598188 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c89fe523-da8a-49af-9ca5-bbdebcf2cf52 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.623871 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c89fe523-da8a-49af-9ca5-bbdebcf2cf52 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:13:29.714809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c89fe523-da8a-49af-9ca5-bbdebcf2cf52 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 204 len: 0 microversion: 2.1 time: 0.129264 Aug 01 14:13:29.715423 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 286/582] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:13:29 2022] DELETE /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:13:29.724357 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-613f6929-a2da-4111-baa3-22105da46321 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:29.725026 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-613f6929-a2da-4111-baa3-22105da46321 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:29.731788 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-613f6929-a2da-4111-baa3-22105da46321 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.732239 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-613f6929-a2da-4111-baa3-22105da46321 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.733042 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-613f6929-a2da-4111-baa3-22105da46321 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.733478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-613f6929-a2da-4111-baa3-22105da46321 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.861642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-e9aeee80-5592-4c52-bc79-397539bc664e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:29.862371 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-e9aeee80-5592-4c52-bc79-397539bc664e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:29.870175 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e9aeee80-5592-4c52-bc79-397539bc664e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.870628 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e9aeee80-5592-4c52-bc79-397539bc664e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.871415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e9aeee80-5592-4c52-bc79-397539bc664e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.871848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e9aeee80-5592-4c52-bc79-397539bc664e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.874912 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-613f6929-a2da-4111-baa3-22105da46321 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:29.883554 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-613f6929-a2da-4111-baa3-22105da46321 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1470 microversion: 2.1 time: 0.163420 Aug 01 14:13:29.884170 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 297/583] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:29 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:30.014420 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-e9aeee80-5592-4c52-bc79-397539bc664e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:30.022901 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-e9aeee80-5592-4c52-bc79-397539bc664e tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.165920 Aug 01 14:13:30.023519 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 287/584] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:29 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:30.067585 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-05ce8272-6525-4e7a-9816-a36afe2badcd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:30.068689 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-05ce8272-6525-4e7a-9816-a36afe2badcd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:30.076684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05ce8272-6525-4e7a-9816-a36afe2badcd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:30.077129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05ce8272-6525-4e7a-9816-a36afe2badcd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:30.077935 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05ce8272-6525-4e7a-9816-a36afe2badcd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:30.078361 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05ce8272-6525-4e7a-9816-a36afe2badcd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:30.231313 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-05ce8272-6525-4e7a-9816-a36afe2badcd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:30.240040 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-05ce8272-6525-4e7a-9816-a36afe2badcd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1362 microversion: 2.1 time: 0.176441 Aug 01 14:13:30.240703 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 298/585] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:30 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:30.915303 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-654fd06f-8d29-4695-99bc-f1fe4b5e855e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:30.915950 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-654fd06f-8d29-4695-99bc-f1fe4b5e855e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:30.923238 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-654fd06f-8d29-4695-99bc-f1fe4b5e855e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:30.923673 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-654fd06f-8d29-4695-99bc-f1fe4b5e855e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:30.924482 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-654fd06f-8d29-4695-99bc-f1fe4b5e855e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:30.924909 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-654fd06f-8d29-4695-99bc-f1fe4b5e855e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:31.045351 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ff3c9c91-815c-4ccb-9f0d-8a49e2c63241 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:31.045974 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ff3c9c91-815c-4ccb-9f0d-8a49e2c63241 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:31.048470 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:31.055749 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff3c9c91-815c-4ccb-9f0d-8a49e2c63241 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:31.056185 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff3c9c91-815c-4ccb-9f0d-8a49e2c63241 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:31.057030 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff3c9c91-815c-4ccb-9f0d-8a49e2c63241 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:31.057435 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff3c9c91-815c-4ccb-9f0d-8a49e2c63241 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:31.073002 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-654fd06f-8d29-4695-99bc-f1fe4b5e855e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:31.081497 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-654fd06f-8d29-4695-99bc-f1fe4b5e855e tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1470 microversion: 2.1 time: 0.170124 Aug 01 14:13:31.082124 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 288/586] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:30 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:31.261476 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-914a6394-8d9d-454a-a1f1-492156bb102a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:31.262122 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-914a6394-8d9d-454a-a1f1-492156bb102a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:31.268886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-914a6394-8d9d-454a-a1f1-492156bb102a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:31.269331 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-914a6394-8d9d-454a-a1f1-492156bb102a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:31.270200 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-914a6394-8d9d-454a-a1f1-492156bb102a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:31.270760 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-914a6394-8d9d-454a-a1f1-492156bb102a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:31.545654 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ff3c9c91-815c-4ccb-9f0d-8a49e2c63241 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:31.550555 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-914a6394-8d9d-454a-a1f1-492156bb102a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:31.556132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ff3c9c91-815c-4ccb-9f0d-8a49e2c63241 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.514702 Aug 01 14:13:31.556754 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 299/587] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:31 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:31.559617 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-914a6394-8d9d-454a-a1f1-492156bb102a tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1362 microversion: 2.1 time: 0.302127 Aug 01 14:13:31.560204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 289/588] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:31 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:32.103153 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b51de2fc-0381-457c-883b-265eb1e7ce1b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:32.103871 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b51de2fc-0381-457c-883b-265eb1e7ce1b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:32.111065 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b51de2fc-0381-457c-883b-265eb1e7ce1b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:32.111506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b51de2fc-0381-457c-883b-265eb1e7ce1b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:32.112360 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b51de2fc-0381-457c-883b-265eb1e7ce1b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:32.112792 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b51de2fc-0381-457c-883b-265eb1e7ce1b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:32.260819 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b51de2fc-0381-457c-883b-265eb1e7ce1b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:32.270536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b51de2fc-0381-457c-883b-265eb1e7ce1b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1470 microversion: 2.1 time: 0.171203 Aug 01 14:13:32.271693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 300/589] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:32 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:32.578380 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4d3f5c60-eed1-4426-9cb0-fc9e15a0641b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:32.579123 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4d3f5c60-eed1-4426-9cb0-fc9e15a0641b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:32.583151 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2c717e27-bd3a-4aed-b2bd-aea61d92aee2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:32.584157 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2c717e27-bd3a-4aed-b2bd-aea61d92aee2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:32.587216 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c60-eed1-4426-9cb0-fc9e15a0641b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:32.587670 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c60-eed1-4426-9cb0-fc9e15a0641b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:32.588556 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c60-eed1-4426-9cb0-fc9e15a0641b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:32.589019 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c60-eed1-4426-9cb0-fc9e15a0641b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:32.591731 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2c717e27-bd3a-4aed-b2bd-aea61d92aee2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:32.592194 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2c717e27-bd3a-4aed-b2bd-aea61d92aee2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:32.593017 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2c717e27-bd3a-4aed-b2bd-aea61d92aee2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:32.593452 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2c717e27-bd3a-4aed-b2bd-aea61d92aee2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:32.922645 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4d3f5c60-eed1-4426-9cb0-fc9e15a0641b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:32.932077 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2c717e27-bd3a-4aed-b2bd-aea61d92aee2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:32.932929 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4d3f5c60-eed1-4426-9cb0-fc9e15a0641b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.358487 Aug 01 14:13:32.933970 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 290/590] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:32 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:32.941707 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2c717e27-bd3a-4aed-b2bd-aea61d92aee2 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1362 microversion: 2.1 time: 0.364702 Aug 01 14:13:32.943649 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 301/591] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:32 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:33.227548 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-1502c682-b763-4fac-8e30-828f856951d4 req-b46e41eb-29b3-43a7-aee2-8f484c0eb6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f2f1f-04ca-4496-84f1-6d78dba974ae", "name": "network-vif-deleted", "tag": "5ac98040-b7c0-45ff-8416-201d90575263"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:33.238067 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-1502c682-b763-4fac-8e30-828f856951d4 req-b46e41eb-29b3-43a7-aee2-8f484c0eb6d7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.238513 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-1502c682-b763-4fac-8e30-828f856951d4 req-b46e41eb-29b3-43a7-aee2-8f484c0eb6d7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.258801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-1502c682-b763-4fac-8e30-828f856951d4 req-b46e41eb-29b3-43a7-aee2-8f484c0eb6d7 service nova] Creating event network-vif-deleted:5ac98040-b7c0-45ff-8416-201d90575263 for instance 3b9f2f1f-04ca-4496-84f1-6d78dba974ae on hv-cinder-84517 Aug 01 14:13:33.264356 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-1502c682-b763-4fac-8e30-828f856951d4 req-b46e41eb-29b3-43a7-aee2-8f484c0eb6d7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040379 Aug 01 14:13:33.267837 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 291/592] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:33.295513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-498bdfc7-837f-4329-8b3c-6c545378f52b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:33.296142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-498bdfc7-837f-4329-8b3c-6c545378f52b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:33.308854 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-498bdfc7-837f-4329-8b3c-6c545378f52b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.309282 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-498bdfc7-837f-4329-8b3c-6c545378f52b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.310270 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-498bdfc7-837f-4329-8b3c-6c545378f52b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.310884 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-498bdfc7-837f-4329-8b3c-6c545378f52b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.383099 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-498bdfc7-837f-4329-8b3c-6c545378f52b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a882cf9cc15457bb5a860963f1967f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aec08b7ce54cb5ad87ea544a819e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:33.391276 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-498bdfc7-837f-4329-8b3c-6c545378f52b tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 200 len: 1299 microversion: 2.1 time: 0.099838 Aug 01 14:13:33.391909 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 302/593] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:33 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:33.952105 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:33.956751 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-86982c87-7ddd-4e03-a8af-d5725a5bce67 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:33.957636 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-86982c87-7ddd-4e03-a8af-d5725a5bce67 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:33.963104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a07087e3-7e33-450c-9691-8603e9429421 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:33.963959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a07087e3-7e33-450c-9691-8603e9429421 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:33.966293 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86982c87-7ddd-4e03-a8af-d5725a5bce67 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.966799 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86982c87-7ddd-4e03-a8af-d5725a5bce67 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.967551 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86982c87-7ddd-4e03-a8af-d5725a5bce67 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.967988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86982c87-7ddd-4e03-a8af-d5725a5bce67 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.971180 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a07087e3-7e33-450c-9691-8603e9429421 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.971959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a07087e3-7e33-450c-9691-8603e9429421 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.973438 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a07087e3-7e33-450c-9691-8603e9429421 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.974292 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a07087e3-7e33-450c-9691-8603e9429421 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.994333 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=8 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:34.206667 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-86982c87-7ddd-4e03-a8af-d5725a5bce67 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:34.209277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:34.214589 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a07087e3-7e33-450c-9691-8603e9429421 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:34.218381 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:34.219039 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-86982c87-7ddd-4e03-a8af-d5725a5bce67 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.268186 Aug 01 14:13:34.219979 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 292/594] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:33 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:34.227305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a07087e3-7e33-450c-9691-8603e9429421 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1362 microversion: 2.1 time: 0.268263 Aug 01 14:13:34.227982 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 303/595] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:33 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:34.413613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:34.414210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] [instance: 3b9f2f1f-04ca-4496-84f1-6d78dba974ae] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:34.421046 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:34.421494 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:34.422279 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:34.422712 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:34.438612 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] HTTP exception thrown: Instance 3b9f2f1f-04ca-4496-84f1-6d78dba974ae could not be found. Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Request method failure captured: Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae HTTP/1.1 Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi599vNhd0E4nnXAzx9t3TxPXuQyDsyw9Hji3ym5nqkURYpWxZTtOYK0bgR-zlQNhF8lzIqMS7QRu-rFR6GFdjCvfZ0jNks1GPWOiJFOTO1xnUJYKG1RUIYoAQUR6QbGPZX1w0huNN0zLuf03fqo3csfJCAZOMbVR-TtRzpP2fljiXj5Q Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 88aec08b7ce54cb5ad87ea544a819e0a Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-VolumesNegativeTest-963250723 Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:13:34.440341 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_88aec08b7ce54cb5ad87ea544a819e0a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/88aec08b7ce54cb5ad87ea544a819e0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/88aec08b7ce54cb5ad87ea544a819e0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/88aec08b7ce54cb5ad87ea544a819e0a"}]}] Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-VolumesNegativeTest-963250723 Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 88aec08b7ce54cb5ad87ea544a819e0a Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-VolumesNegativeTest-963250723 Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-VolumesNegativeTest-963250723-project Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 9a882cf9cc15457bb5a860963f1967f2 Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-VolumesNegativeTest-963250723-project Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 3b9f2f1f-04ca-4496-84f1-6d78dba974ae could not be found. Aug 01 14:13:34.441840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '3b9f2f1f-04ca-4496-84f1-6d78dba974ae'} Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9f2f1f-04ca-4496-84f1-6d78dba974ae could not be found. Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:34.442619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9f2f1f-04ca-4496-84f1-6d78dba974ae could not be found. Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9f2f1f-04ca-4496-84f1-6d78dba974ae could not be found. Aug 01 14:13:34.443801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:34.444887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] Returning 404 to user: Instance 3b9f2f1f-04ca-4496-84f1-6d78dba974ae could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:34.444887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f402a56d-22bc-44df-8198-ec494770bdd8 tempest-VolumesNegativeTest-963250723 tempest-VolumesNegativeTest-963250723-project] 10.222.0.45 "GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae" status: 404 len: 111 microversion: 2.1 time: 0.032647 Aug 01 14:13:34.444887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 293/596] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:34 2022] GET /compute/v2.1/servers/3b9f2f1f-04ca-4496-84f1-6d78dba974ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:13:35.247543 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2afed757-3728-4421-b795-d728de93b669 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:35.248695 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2afed757-3728-4421-b795-d728de93b669 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:35.252583 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-67935156-17f6-446c-812d-88279eda6568 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:35.253417 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-67935156-17f6-446c-812d-88279eda6568 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:35.258030 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2afed757-3728-4421-b795-d728de93b669 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:35.258465 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2afed757-3728-4421-b795-d728de93b669 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:35.259243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2afed757-3728-4421-b795-d728de93b669 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:35.259675 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2afed757-3728-4421-b795-d728de93b669 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:35.261969 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-67935156-17f6-446c-812d-88279eda6568 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:35.262487 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-67935156-17f6-446c-812d-88279eda6568 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:35.263480 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-67935156-17f6-446c-812d-88279eda6568 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:35.263910 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-67935156-17f6-446c-812d-88279eda6568 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:35.476213 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2afed757-3728-4421-b795-d728de93b669 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:35.483796 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-67935156-17f6-446c-812d-88279eda6568 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:35.486505 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2afed757-3728-4421-b795-d728de93b669 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.242615 Aug 01 14:13:35.488043 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 304/597] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:35 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:35.500847 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-67935156-17f6-446c-812d-88279eda6568 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1362 microversion: 2.1 time: 0.253101 Aug 01 14:13:35.501539 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 294/598] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:35 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:36.134068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-be124720-c964-4203-bb8d-999e4e524244 req-6d7dfe89-71c1-4bfe-9ef3-98a6f24976a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462a7ad5-816c-49b1-a36b-84dc587c93ca", "name": "network-vif-plugged", "status": "completed", "tag": "41238094-cf08-4cf7-b716-88a929b830bb"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:36.143120 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-be124720-c964-4203-bb8d-999e4e524244 req-6d7dfe89-71c1-4bfe-9ef3-98a6f24976a0 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:36.143617 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-be124720-c964-4203-bb8d-999e4e524244 req-6d7dfe89-71c1-4bfe-9ef3-98a6f24976a0 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:36.158447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-be124720-c964-4203-bb8d-999e4e524244 req-6d7dfe89-71c1-4bfe-9ef3-98a6f24976a0 service nova] Creating event network-vif-plugged:41238094-cf08-4cf7-b716-88a929b830bb for instance 462a7ad5-816c-49b1-a36b-84dc587c93ca on hv-cinder-84517 Aug 01 14:13:36.165297 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-be124720-c964-4203-bb8d-999e4e524244 req-6d7dfe89-71c1-4bfe-9ef3-98a6f24976a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037768 Aug 01 14:13:36.166234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 305/599] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:36.513548 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d2906a61-b8a9-4a4b-95a0-f64cf670c268 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:36.513548 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d2906a61-b8a9-4a4b-95a0-f64cf670c268 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:36.521539 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d2906a61-b8a9-4a4b-95a0-f64cf670c268 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:36.522061 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d2906a61-b8a9-4a4b-95a0-f64cf670c268 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:36.523132 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d2906a61-b8a9-4a4b-95a0-f64cf670c268 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:36.523652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d2906a61-b8a9-4a4b-95a0-f64cf670c268 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:36.528541 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-87253b45-31f5-4f69-9416-bffb3230f818 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:36.529268 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-87253b45-31f5-4f69-9416-bffb3230f818 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:36.539562 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-87253b45-31f5-4f69-9416-bffb3230f818 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:36.540204 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-87253b45-31f5-4f69-9416-bffb3230f818 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:36.541220 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-87253b45-31f5-4f69-9416-bffb3230f818 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:36.541681 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-87253b45-31f5-4f69-9416-bffb3230f818 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:36.755881 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d2906a61-b8a9-4a4b-95a0-f64cf670c268 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:36.763698 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-87253b45-31f5-4f69-9416-bffb3230f818 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:36.765362 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d2906a61-b8a9-4a4b-95a0-f64cf670c268 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.256845 Aug 01 14:13:36.766259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 295/600] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:36 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:36.773896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-87253b45-31f5-4f69-9416-bffb3230f818 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1362 microversion: 2.1 time: 0.251709 Aug 01 14:13:36.774483 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 306/601] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:36 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:37.788165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8456151c-227d-4ab0-a3cb-2795d4049059 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:37.788777 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8456151c-227d-4ab0-a3cb-2795d4049059 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:37.796123 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8456151c-227d-4ab0-a3cb-2795d4049059 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:37.796607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8456151c-227d-4ab0-a3cb-2795d4049059 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:37.796859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d13f1590-a5a4-4ea2-9521-f059c53d3dd4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:37.797411 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8456151c-227d-4ab0-a3cb-2795d4049059 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:37.797596 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d13f1590-a5a4-4ea2-9521-f059c53d3dd4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:37.797815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8456151c-227d-4ab0-a3cb-2795d4049059 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:37.804882 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d13f1590-a5a4-4ea2-9521-f059c53d3dd4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:37.805333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d13f1590-a5a4-4ea2-9521-f059c53d3dd4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:37.806120 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d13f1590-a5a4-4ea2-9521-f059c53d3dd4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:37.806550 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d13f1590-a5a4-4ea2-9521-f059c53d3dd4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:38.009657 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8456151c-227d-4ab0-a3cb-2795d4049059 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:38.013068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d13f1590-a5a4-4ea2-9521-f059c53d3dd4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:38.018896 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8456151c-227d-4ab0-a3cb-2795d4049059 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.235133 Aug 01 14:13:38.019494 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 296/602] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:37 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:38.021383 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d13f1590-a5a4-4ea2-9521-f059c53d3dd4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1362 microversion: 2.1 time: 0.228558 Aug 01 14:13:38.021957 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 307/603] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:37 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:39.043030 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-42c878b2-deb6-4e5f-89fd-b4a0aafe1604 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:39.043641 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1d2c4a88-d24d-4476-8f76-9b43efd29cd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:39.043997 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1d2c4a88-d24d-4476-8f76-9b43efd29cd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:39.044941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-42c878b2-deb6-4e5f-89fd-b4a0aafe1604 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:39.050827 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1d2c4a88-d24d-4476-8f76-9b43efd29cd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.051405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1d2c4a88-d24d-4476-8f76-9b43efd29cd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.052329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1d2c4a88-d24d-4476-8f76-9b43efd29cd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.052460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42c878b2-deb6-4e5f-89fd-b4a0aafe1604 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.052856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42c878b2-deb6-4e5f-89fd-b4a0aafe1604 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.053258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1d2c4a88-d24d-4476-8f76-9b43efd29cd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.053642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42c878b2-deb6-4e5f-89fd-b4a0aafe1604 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.054273 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42c878b2-deb6-4e5f-89fd-b4a0aafe1604 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.301134 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1d2c4a88-d24d-4476-8f76-9b43efd29cd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:39.303569 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-42c878b2-deb6-4e5f-89fd-b4a0aafe1604 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:39.310108 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1d2c4a88-d24d-4476-8f76-9b43efd29cd9 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1549 microversion: 2.1 time: 0.271161 Aug 01 14:13:39.311094 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 308/604] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:39 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1549 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:39.312512 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-42c878b2-deb6-4e5f-89fd-b4a0aafe1604 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.273885 Aug 01 14:13:39.313083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 297/605] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:39 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:39.339466 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-967d9181-0791-4d66-9e6a-0ebb74d74bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:39.340316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-967d9181-0791-4d66-9e6a-0ebb74d74bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:39.348495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-967d9181-0791-4d66-9e6a-0ebb74d74bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.348795 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-967d9181-0791-4d66-9e6a-0ebb74d74bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.349973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-967d9181-0791-4d66-9e6a-0ebb74d74bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.350381 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-967d9181-0791-4d66-9e6a-0ebb74d74bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.443633 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-967d9181-0791-4d66-9e6a-0ebb74d74bc5 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112300 Aug 01 14:13:39.444553 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 309/606] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 14:13:39 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:40.518751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-72f79653-f441-43c6-af05-236179817a0f req-15c69b2e-a1a0-4175-a5f6-b35548ce4394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462a7ad5-816c-49b1-a36b-84dc587c93ca", "tag": "41238094-cf08-4cf7-b716-88a929b830bb"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:40.528375 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-72f79653-f441-43c6-af05-236179817a0f req-15c69b2e-a1a0-4175-a5f6-b35548ce4394 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:40.528848 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-72f79653-f441-43c6-af05-236179817a0f req-15c69b2e-a1a0-4175-a5f6-b35548ce4394 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:40.541193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-72f79653-f441-43c6-af05-236179817a0f req-15c69b2e-a1a0-4175-a5f6-b35548ce4394 service nova] Creating event network-changed:41238094-cf08-4cf7-b716-88a929b830bb for instance 462a7ad5-816c-49b1-a36b-84dc587c93ca on hv-cinder-84517 Aug 01 14:13:40.546799 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-72f79653-f441-43c6-af05-236179817a0f req-15c69b2e-a1a0-4175-a5f6-b35548ce4394 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032529 Aug 01 14:13:40.547667 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 310/607] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:40.609848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4e5b612e-0440-41aa-96fd-f80dcf8af413 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:40.610563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4e5b612e-0440-41aa-96fd-f80dcf8af413 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:40.617752 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4e5b612e-0440-41aa-96fd-f80dcf8af413 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:40.618199 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4e5b612e-0440-41aa-96fd-f80dcf8af413 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:40.619002 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4e5b612e-0440-41aa-96fd-f80dcf8af413 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:40.619429 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4e5b612e-0440-41aa-96fd-f80dcf8af413 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:40.775859 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4e5b612e-0440-41aa-96fd-f80dcf8af413 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:40.785075 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4e5b612e-0440-41aa-96fd-f80dcf8af413 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1737 microversion: 2.1 time: 0.446034 Aug 01 14:13:40.786630 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 298/608] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:40 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1737 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:41.807993 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c0e4f0da-6879-47cd-83f0-94f51c783cc5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:41.808705 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c0e4f0da-6879-47cd-83f0-94f51c783cc5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:41.817585 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0e4f0da-6879-47cd-83f0-94f51c783cc5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:41.818329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0e4f0da-6879-47cd-83f0-94f51c783cc5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:41.819538 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0e4f0da-6879-47cd-83f0-94f51c783cc5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:41.820302 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0e4f0da-6879-47cd-83f0-94f51c783cc5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:42.047579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c0e4f0da-6879-47cd-83f0-94f51c783cc5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:42.056305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c0e4f0da-6879-47cd-83f0-94f51c783cc5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1717 microversion: 2.1 time: 0.252681 Aug 01 14:13:42.056875 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 311/609] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:41 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1717 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:42.119122 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:42.119672 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:42.126733 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:42.127160 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:42.128009 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:42.128423 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:42.213314 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] HTTP exception thrown: Cannot 'detach_volume' instance b69e5d2d-0483-4373-aa71-ea2305f287d3 while it is in vm_state rescued Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Request method failure captured: Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: DELETE /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments/d231e51d-b788-42cf-b91f-a29fc26fa865 HTTP/1.1 Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi595nBvngFLvXmcxyqRbq0vAZso55lRqZPdXo9mG7MzO7BEgpjGUJXmDJ-Wrlr5gSX2E3O49ldx2NkMHkhpNVEedoqx6r8Ucd5xA2QvZhi4cW0ovwwW2Ary3iU0xyJcDZxg2MxyAC0etakIhVNhyVB6hrmON2qyAVhF4w9-kPyJ8xt6U Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:13:42.215159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e85f3e6c18ae4466a1dc3e6464aa18e6", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}] Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: a3e93dfa85244133b1641a431994b47f Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:13:42.216930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Cannot 'detach_volume' instance b69e5d2d-0483-4373-aa71-ea2305f287d3 while it is in vm_state rescued Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'server_id': 'b69e5d2d-0483-4373-aa71-ea2305f287d3', 'id': 'd231e51d-b788-42cf-b91f-a29fc26fa865'} Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b69e5d2d-0483-4373-aa71-ea2305f287d3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:42.217887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b69e5d2d-0483-4373-aa71-ea2305f287d3 while it is in vm_state rescued Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b69e5d2d-0483-4373-aa71-ea2305f287d3 while it is in vm_state rescued Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:13:42.219347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Returning 409 to user: Cannot 'detach_volume' instance b69e5d2d-0483-4373-aa71-ea2305f287d3 while it is in vm_state rescued {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:42.220622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-98349c5a-6a9f-44f0-a192-3092eef94281 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments/d231e51d-b788-42cf-b91f-a29fc26fa865" status: 409 len: 152 microversion: 2.1 time: 0.101625 Aug 01 14:13:42.220622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 299/610] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:13:42 2022] DELETE /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments/d231e51d-b788-42cf-b91f-a29fc26fa865 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 01 14:13:42.226398 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2ede0bf6-beb7-4143-a5c8-a539602c3b6f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:42.226921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2ede0bf6-beb7-4143-a5c8-a539602c3b6f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:42.233140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2ede0bf6-beb7-4143-a5c8-a539602c3b6f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:42.233563 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2ede0bf6-beb7-4143-a5c8-a539602c3b6f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:42.234332 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2ede0bf6-beb7-4143-a5c8-a539602c3b6f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:42.234755 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2ede0bf6-beb7-4143-a5c8-a539602c3b6f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:42.307144 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2ede0bf6-beb7-4143-a5c8-a539602c3b6f tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "POST /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/action" status: 202 len: 0 microversion: 2.1 time: 0.084384 Aug 01 14:13:42.307797 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 312/611] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:13:42 2022] POST /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:13:42.317639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8fd01de8-f892-4944-baf8-5965bed17345 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:42.318641 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8fd01de8-f892-4944-baf8-5965bed17345 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:42.326589 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8fd01de8-f892-4944-baf8-5965bed17345 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:42.327203 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8fd01de8-f892-4944-baf8-5965bed17345 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:42.328536 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8fd01de8-f892-4944-baf8-5965bed17345 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:42.329064 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8fd01de8-f892-4944-baf8-5965bed17345 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:42.594259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8fd01de8-f892-4944-baf8-5965bed17345 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:42.604516 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8fd01de8-f892-4944-baf8-5965bed17345 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1725 microversion: 2.1 time: 0.291818 Aug 01 14:13:42.605100 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 300/612] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:42 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:43.627414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eba732bf-af74-43d6-9fcb-edaacd22bdeb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:43.628115 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eba732bf-af74-43d6-9fcb-edaacd22bdeb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:43.635937 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eba732bf-af74-43d6-9fcb-edaacd22bdeb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:43.636404 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eba732bf-af74-43d6-9fcb-edaacd22bdeb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:43.637191 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eba732bf-af74-43d6-9fcb-edaacd22bdeb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:43.637613 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eba732bf-af74-43d6-9fcb-edaacd22bdeb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:43.794682 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eba732bf-af74-43d6-9fcb-edaacd22bdeb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:43.805735 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eba732bf-af74-43d6-9fcb-edaacd22bdeb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1725 microversion: 2.1 time: 0.182694 Aug 01 14:13:43.806239 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 313/613] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:43 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:44.831917 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-72114688-2576-423d-a4bb-d83d6d33de87 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:44.833382 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-72114688-2576-423d-a4bb-d83d6d33de87 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:44.846281 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-72114688-2576-423d-a4bb-d83d6d33de87 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:44.847036 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-72114688-2576-423d-a4bb-d83d6d33de87 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:44.848395 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-72114688-2576-423d-a4bb-d83d6d33de87 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:44.849117 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-72114688-2576-423d-a4bb-d83d6d33de87 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:44.985433 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-72114688-2576-423d-a4bb-d83d6d33de87 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:44.999970 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-72114688-2576-423d-a4bb-d83d6d33de87 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1725 microversion: 2.1 time: 0.174911 Aug 01 14:13:45.000647 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 301/614] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:44 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:46.022388 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-98068882-b9d4-466a-85ad-a399b2a517a5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:46.023040 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-98068882-b9d4-466a-85ad-a399b2a517a5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:46.029822 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98068882-b9d4-466a-85ad-a399b2a517a5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:46.030266 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98068882-b9d4-466a-85ad-a399b2a517a5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:46.031039 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98068882-b9d4-466a-85ad-a399b2a517a5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:46.031476 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98068882-b9d4-466a-85ad-a399b2a517a5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:46.166658 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-98068882-b9d4-466a-85ad-a399b2a517a5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:46.174888 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-98068882-b9d4-466a-85ad-a399b2a517a5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1731 microversion: 2.1 time: 0.156667 Aug 01 14:13:46.175471 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 314/615] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:46 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:46.197681 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a2a05a8b-9f69-4670-b6cf-3d3888deeba5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:46.198313 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a2a05a8b-9f69-4670-b6cf-3d3888deeba5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:46.206069 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2a05a8b-9f69-4670-b6cf-3d3888deeba5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:46.206564 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2a05a8b-9f69-4670-b6cf-3d3888deeba5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:46.207335 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2a05a8b-9f69-4670-b6cf-3d3888deeba5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:46.207762 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2a05a8b-9f69-4670-b6cf-3d3888deeba5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:46.301069 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a2a05a8b-9f69-4670-b6cf-3d3888deeba5 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109077 Aug 01 14:13:46.301806 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 302/616] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 14:13:46 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:47.500392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-4cf39514-6cd1-4d57-b5b7-f96b92a319de req-e0008592-0711-4f33-a0b9-c046da18f4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69e5d2d-0483-4373-aa71-ea2305f287d3", "tag": "03542f14-88d5-4bf6-9c7d-0dcbe18589a5"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:47.511117 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4cf39514-6cd1-4d57-b5b7-f96b92a319de req-e0008592-0711-4f33-a0b9-c046da18f4dd service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:47.511620 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4cf39514-6cd1-4d57-b5b7-f96b92a319de req-e0008592-0711-4f33-a0b9-c046da18f4dd service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:47.527393 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-4cf39514-6cd1-4d57-b5b7-f96b92a319de req-e0008592-0711-4f33-a0b9-c046da18f4dd service nova] Creating event network-changed:03542f14-88d5-4bf6-9c7d-0dcbe18589a5 for instance b69e5d2d-0483-4373-aa71-ea2305f287d3 on hv-cinder-84517 Aug 01 14:13:47.533680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-4cf39514-6cd1-4d57-b5b7-f96b92a319de req-e0008592-0711-4f33-a0b9-c046da18f4dd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036587 Aug 01 14:13:47.534447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 315/617] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:49.552230 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-8ba99fb5-245a-4dc1-8847-afada37f4cb8 req-e1e3511c-99f4-4d71-a35a-bc45a73e485d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69e5d2d-0483-4373-aa71-ea2305f287d3", "tag": "03542f14-88d5-4bf6-9c7d-0dcbe18589a5"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:49.562569 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-8ba99fb5-245a-4dc1-8847-afada37f4cb8 req-e1e3511c-99f4-4d71-a35a-bc45a73e485d service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:49.563225 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-8ba99fb5-245a-4dc1-8847-afada37f4cb8 req-e1e3511c-99f4-4d71-a35a-bc45a73e485d service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:49.576505 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-8ba99fb5-245a-4dc1-8847-afada37f4cb8 req-e1e3511c-99f4-4d71-a35a-bc45a73e485d service nova] Creating event network-changed:03542f14-88d5-4bf6-9c7d-0dcbe18589a5 for instance b69e5d2d-0483-4373-aa71-ea2305f287d3 on hv-cinder-84517 Aug 01 14:13:49.582026 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-8ba99fb5-245a-4dc1-8847-afada37f4cb8 req-e1e3511c-99f4-4d71-a35a-bc45a73e485d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033988 Aug 01 14:13:49.582797 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 303/618] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:56.915400 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-90704758-deab-4363-9476-b34e5fb9cd27 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-96042402"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:56.916470 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-90704758-deab-4363-9476-b34e5fb9cd27 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:56.918284 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=58 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:56.927207 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90704758-deab-4363-9476-b34e5fb9cd27 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:56.927989 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90704758-deab-4363-9476-b34e5fb9cd27 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:56.929350 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90704758-deab-4363-9476-b34e5fb9cd27 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:56.930116 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90704758-deab-4363-9476-b34e5fb9cd27 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:57.108415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.network.security_group_api [None req-90704758-deab-4363-9476-b34e5fb9cd27 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Removing security group 15fdec87-58f8-4692-a670-2b644260c755 from port 1bf0befb-0ac8-4221-a091-92283e46d506 Aug 01 14:13:57.514305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-90704758-deab-4363-9476-b34e5fb9cd27 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "POST /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/action" status: 202 len: 0 microversion: 2.1 time: 0.604547 Aug 01 14:13:57.523141 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 316/619] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:13:56 2022] POST /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:13:57.635493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-0ac3b885-ada6-48d4-8eb8-930bafda415d req-73e67db9-7ed9-450a-a899-2beef687a7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dd2869-e1f8-4607-8fc8-63858730bcc3", "tag": "1bf0befb-0ac8-4221-a091-92283e46d506"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:57.647095 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:57.651500 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-0ac3b885-ada6-48d4-8eb8-930bafda415d req-73e67db9-7ed9-450a-a899-2beef687a7d1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:57.652652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-0ac3b885-ada6-48d4-8eb8-930bafda415d req-73e67db9-7ed9-450a-a899-2beef687a7d1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:57.678532 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-0ac3b885-ada6-48d4-8eb8-930bafda415d req-73e67db9-7ed9-450a-a899-2beef687a7d1 service nova] Creating event network-changed:1bf0befb-0ac8-4221-a091-92283e46d506 for instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 on hv-cinder-84517 Aug 01 14:13:57.689016 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-0ac3b885-ada6-48d4-8eb8-930bafda415d req-73e67db9-7ed9-450a-a899-2beef687a7d1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161561 Aug 01 14:13:57.692394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 304/620] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:58.930124 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fdc9a921-127c-4b80-939f-24fa80a699ce tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:58.930848 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fdc9a921-127c-4b80-939f-24fa80a699ce tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:58.942914 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdc9a921-127c-4b80-939f-24fa80a699ce tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:58.943471 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdc9a921-127c-4b80-939f-24fa80a699ce tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:58.944441 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdc9a921-127c-4b80-939f-24fa80a699ce tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:58.944875 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdc9a921-127c-4b80-939f-24fa80a699ce tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.005620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-c9bc7d32-9293-441b-a76c-0525a5df1c2e req-0f887341-bfa4-49be-b506-a394d0f66c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dd2869-e1f8-4607-8fc8-63858730bcc3", "tag": "1bf0befb-0ac8-4221-a091-92283e46d506"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:59.016739 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-c9bc7d32-9293-441b-a76c-0525a5df1c2e req-0f887341-bfa4-49be-b506-a394d0f66c77 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:59.017158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-c9bc7d32-9293-441b-a76c-0525a5df1c2e req-0f887341-bfa4-49be-b506-a394d0f66c77 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.030360 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-c9bc7d32-9293-441b-a76c-0525a5df1c2e req-0f887341-bfa4-49be-b506-a394d0f66c77 service nova] Creating event network-changed:1bf0befb-0ac8-4221-a091-92283e46d506 for instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 on hv-cinder-84517 Aug 01 14:13:59.036083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-c9bc7d32-9293-441b-a76c-0525a5df1c2e req-0f887341-bfa4-49be-b506-a394d0f66c77 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112539 Aug 01 14:13:59.037460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 305/621] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:59.093006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-fdc9a921-127c-4b80-939f-24fa80a699ce tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lazy-loading 'services' on Instance uuid f5dd2869-e1f8-4607-8fc8-63858730bcc3 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:13:59.274694 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fdc9a921-127c-4b80-939f-24fa80a699ce tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments/8db5c354-9003-45f5-8b92-695a830c4a2a" status: 202 len: 0 microversion: 2.1 time: 0.352383 Aug 01 14:13:59.275607 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 317/622] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:13:58 2022] DELETE /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments/8db5c354-9003-45f5-8b92-695a830c4a2a => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:13:59.286726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-589f1169-b8f0-428e-b72b-471e2be5a090 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:59.289101 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-589f1169-b8f0-428e-b72b-471e2be5a090 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:59.304923 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-589f1169-b8f0-428e-b72b-471e2be5a090 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:59.305995 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-589f1169-b8f0-428e-b72b-471e2be5a090 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.311920 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-589f1169-b8f0-428e-b72b-471e2be5a090 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:59.312847 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-589f1169-b8f0-428e-b72b-471e2be5a090 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.388224 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-589f1169-b8f0-428e-b72b-471e2be5a090 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105766 Aug 01 14:13:59.391226 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 306/623] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:13:59 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:14:00.408924 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e79dabd5-546d-42a3-878a-9bd2ca6f9992 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:00.413263 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e79dabd5-546d-42a3-878a-9bd2ca6f9992 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:00.427981 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e79dabd5-546d-42a3-878a-9bd2ca6f9992 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:00.428771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e79dabd5-546d-42a3-878a-9bd2ca6f9992 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:00.430274 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e79dabd5-546d-42a3-878a-9bd2ca6f9992 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:00.430992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e79dabd5-546d-42a3-878a-9bd2ca6f9992 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:00.484965 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e79dabd5-546d-42a3-878a-9bd2ca6f9992 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083728 Aug 01 14:14:00.490897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 318/624] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:00 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:14:00.497331 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:00.497994 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:00.506062 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:00.506532 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:00.507326 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:00.507759 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:00.608686 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] HTTP exception thrown: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 is not attached to volume 8db5c354-9003-45f5-8b92-695a830c4a2a Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Request method failure captured: Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: DELETE /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments/8db5c354-9003-45f5-8b92-695a830c4a2a HTTP/1.1 Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi596yr2hdKO3QUnQxgGwGbYB0yRZveuKH9ORrXlAIsw7ZYIkaY92LLt4leBQ73tEjhwufyG9xAOR4XvC42VnuacpfsG5KKfnQLr0uPW4v4rVikg1s3d_gmtsq6ljLwhTN9q-T0dqMLAu22QltnY3DG5gMxwe5XuzmAArMJ-45W2wEsWQ Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 9d78f1cca2f845a5ad90c514c2d71f62 Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-TestMinimumBasicScenario-2033238848 Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:14:00.618535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9d78f1cca2f845a5ad90c514c2d71f62", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d78f1cca2f845a5ad90c514c2d71f62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d78f1cca2f845a5ad90c514c2d71f62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9d78f1cca2f845a5ad90c514c2d71f62"}]}] Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-TestMinimumBasicScenario-2033238848 Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 9d78f1cca2f845a5ad90c514c2d71f62 Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2033238848 Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-TestMinimumBasicScenario-2033238848-project Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: ec40d75e772442d2a97e9bf18b4b90c8 Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-TestMinimumBasicScenario-2033238848-project Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:14:00.620220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 is not attached to volume 8db5c354-9003-45f5-8b92-695a830c4a2a Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'server_id': 'f5dd2869-e1f8-4607-8fc8-63858730bcc3', 'id': '8db5c354-9003-45f5-8b92-695a830c4a2a'} Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8db5c354-9003-45f5-8b92-695a830c4a2a. Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:14:00.621094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 is not attached to volume 8db5c354-9003-45f5-8b92-695a830c4a2a Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 is not attached to volume 8db5c354-9003-45f5-8b92-695a830c4a2a Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:00.622510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Returning 404 to user: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 is not attached to volume 8db5c354-9003-45f5-8b92-695a830c4a2a {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:14:00.623599 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5483f261-d56b-4655-977a-c47733b1671e tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments/8db5c354-9003-45f5-8b92-695a830c4a2a" status: 404 len: 154 microversion: 2.1 time: 0.128509 Aug 01 14:14:00.623599 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 307/625] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:14:00 2022] DELETE /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3/os-volume_attachments/8db5c354-9003-45f5-8b92-695a830c4a2a => generated 154 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:14:01.781745 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8a68813b-317f-4d6f-a185-048743cee5fd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:01.782341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8a68813b-317f-4d6f-a185-048743cee5fd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:01.790165 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8a68813b-317f-4d6f-a185-048743cee5fd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:01.790602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8a68813b-317f-4d6f-a185-048743cee5fd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:01.791365 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8a68813b-317f-4d6f-a185-048743cee5fd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:01.791807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8a68813b-317f-4d6f-a185-048743cee5fd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:01.817763 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8a68813b-317f-4d6f-a185-048743cee5fd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:14:01.875362 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:01.917192 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8a68813b-317f-4d6f-a185-048743cee5fd tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 204 len: 0 microversion: 2.1 time: 0.139075 Aug 01 14:14:01.918008 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 319/626] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:14:01 2022] DELETE /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:14:01.926956 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d7cc3c05-0d6b-4c39-8df5-6fe5c26c8322 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:01.927565 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d7cc3c05-0d6b-4c39-8df5-6fe5c26c8322 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:01.940106 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d7cc3c05-0d6b-4c39-8df5-6fe5c26c8322 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:01.940585 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d7cc3c05-0d6b-4c39-8df5-6fe5c26c8322 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:01.941415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d7cc3c05-0d6b-4c39-8df5-6fe5c26c8322 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:01.941843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d7cc3c05-0d6b-4c39-8df5-6fe5c26c8322 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:02.087213 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d7cc3c05-0d6b-4c39-8df5-6fe5c26c8322 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:02.096648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d7cc3c05-0d6b-4c39-8df5-6fe5c26c8322 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1552 microversion: 2.1 time: 0.173542 Aug 01 14:14:02.097248 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 308/627] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:01 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:03.118667 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ecc6acb6-3339-403d-8cff-7f29215b9077 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:03.119365 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ecc6acb6-3339-403d-8cff-7f29215b9077 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:03.126318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecc6acb6-3339-403d-8cff-7f29215b9077 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:03.126757 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecc6acb6-3339-403d-8cff-7f29215b9077 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:03.127530 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecc6acb6-3339-403d-8cff-7f29215b9077 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:03.127954 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ecc6acb6-3339-403d-8cff-7f29215b9077 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:03.279926 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ecc6acb6-3339-403d-8cff-7f29215b9077 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:03.293444 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ecc6acb6-3339-403d-8cff-7f29215b9077 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1552 microversion: 2.1 time: 0.179103 Aug 01 14:14:03.294422 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 320/628] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:03 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:04.315545 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-59778ba9-3671-459f-8d09-666409e699b1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:04.316216 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-59778ba9-3671-459f-8d09-666409e699b1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:04.323577 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-59778ba9-3671-459f-8d09-666409e699b1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:04.324141 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-59778ba9-3671-459f-8d09-666409e699b1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:04.325016 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-59778ba9-3671-459f-8d09-666409e699b1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:04.325514 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-59778ba9-3671-459f-8d09-666409e699b1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:04.551883 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-2acae91a-50c0-4b96-bc85-b1d4b45dfcb7 req-a529ebad-c45d-4e97-9d40-a87f749588e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dd2869-e1f8-4607-8fc8-63858730bcc3", "name": "network-vif-deleted", "tag": "1bf0befb-0ac8-4221-a091-92283e46d506"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:04.566591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-59778ba9-3671-459f-8d09-666409e699b1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec40d75e772442d2a97e9bf18b4b90c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d78f1cca2f845a5ad90c514c2d71f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:04.569338 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=84 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:04.570480 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-2acae91a-50c0-4b96-bc85-b1d4b45dfcb7 req-a529ebad-c45d-4e97-9d40-a87f749588e1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:04.570930 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-2acae91a-50c0-4b96-bc85-b1d4b45dfcb7 req-a529ebad-c45d-4e97-9d40-a87f749588e1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:04.576504 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-59778ba9-3671-459f-8d09-666409e699b1 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 200 len: 1552 microversion: 2.1 time: 0.265181 Aug 01 14:14:04.577098 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 309/629] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:04 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 1552 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:04.583931 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-2acae91a-50c0-4b96-bc85-b1d4b45dfcb7 req-a529ebad-c45d-4e97-9d40-a87f749588e1 service nova] Creating event network-vif-deleted:1bf0befb-0ac8-4221-a091-92283e46d506 for instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 on hv-cinder-84517 Aug 01 14:14:04.591234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-2acae91a-50c0-4b96-bc85-b1d4b45dfcb7 req-a529ebad-c45d-4e97-9d40-a87f749588e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042872 Aug 01 14:14:04.591958 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 321/630] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:05.604005 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:05.605165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] [instance: f5dd2869-e1f8-4607-8fc8-63858730bcc3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:05.616613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:05.617380 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:05.618735 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:05.619278 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:05.635264 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] HTTP exception thrown: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 could not be found. Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Request method failure captured: Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 HTTP/1.1 Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi596yr2hdKO3QUnQxgGwGbYB0yRZveuKH9ORrXlAIsw7ZYIkaY92LLt4leBQ73tEjhwufyG9xAOR4XvC42VnuacpfsG5KKfnQLr0uPW4v4rVikg1s3d_gmtsq6ljLwhTN9q-T0dqMLAu22QltnY3DG5gMxwe5XuzmAArMJ-45W2wEsWQ Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 9d78f1cca2f845a5ad90c514c2d71f62 Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-TestMinimumBasicScenario-2033238848 Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:14:05.637178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9d78f1cca2f845a5ad90c514c2d71f62", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d78f1cca2f845a5ad90c514c2d71f62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d78f1cca2f845a5ad90c514c2d71f62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9d78f1cca2f845a5ad90c514c2d71f62"}]}] Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-TestMinimumBasicScenario-2033238848 Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 9d78f1cca2f845a5ad90c514c2d71f62 Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2033238848 Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-TestMinimumBasicScenario-2033238848-project Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: ec40d75e772442d2a97e9bf18b4b90c8 Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-TestMinimumBasicScenario-2033238848-project Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 could not be found. Aug 01 14:14:05.639852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': 'f5dd2869-e1f8-4607-8fc8-63858730bcc3'} Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 could not be found. Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:14:05.640998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 could not be found. Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 could not be found. Aug 01 14:14:05.643089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:05.644932 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Returning 404 to user: Instance f5dd2869-e1f8-4607-8fc8-63858730bcc3 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:14:05.644932 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-07cbcce5-b6a9-4ad2-ac80-96ef3ca6a26d tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3" status: 404 len: 111 microversion: 2.1 time: 0.042771 Aug 01 14:14:05.644932 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 310/631] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:05 2022] GET /compute/v2.1/servers/f5dd2869-e1f8-4607-8fc8-63858730bcc3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:14:05.651692 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e9a63fc1-f3bc-4638-97c1-55277610d256 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] Calling method '.version_select at 0x7fc5797cd9d0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:05.676033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e9a63fc1-f3bc-4638-97c1-55277610d256 tempest-TestMinimumBasicScenario-2033238848 tempest-TestMinimumBasicScenario-2033238848-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-384530358" status: 202 len: 0 microversion: 2.1 time: 0.029252 Aug 01 14:14:05.676878 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 322/632] 10.222.0.45 () {58 vars in 1269 bytes} [Mon Aug 1 14:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-384530358 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:14:07.238247 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bcff8052-9e78-4ae0-b98e-e6ce588fa0d1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:07.239014 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bcff8052-9e78-4ae0-b98e-e6ce588fa0d1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:07.245825 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bcff8052-9e78-4ae0-b98e-e6ce588fa0d1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.246309 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bcff8052-9e78-4ae0-b98e-e6ce588fa0d1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.247118 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bcff8052-9e78-4ae0-b98e-e6ce588fa0d1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.247579 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bcff8052-9e78-4ae0-b98e-e6ce588fa0d1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.281164 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bcff8052-9e78-4ae0-b98e-e6ce588fa0d1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments/5b3d3fcd-a957-433c-a18f-65dad11ca2e0" status: 200 len: 194 microversion: 2.20 time: 0.047264 Aug 01 14:14:07.282267 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 311/633] 10.222.0.45 () {60 vars in 1454 bytes} [Mon Aug 1 14:14:07 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments/5b3d3fcd-a957-433c-a18f-65dad11ca2e0 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:14:07.359968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-17a8a019-c310-40db-a0ee-8f59d38adff6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:07.360973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-17a8a019-c310-40db-a0ee-8f59d38adff6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:07.374921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17a8a019-c310-40db-a0ee-8f59d38adff6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.375711 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17a8a019-c310-40db-a0ee-8f59d38adff6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.377160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17a8a019-c310-40db-a0ee-8f59d38adff6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.377960 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17a8a019-c310-40db-a0ee-8f59d38adff6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.486314 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-17a8a019-c310-40db-a0ee-8f59d38adff6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lazy-loading 'services' on Instance uuid 446cfa38-0982-47b2-8e3f-a44a35257447 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:14:07.581306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-17a8a019-c310-40db-a0ee-8f59d38adff6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "DELETE /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments/5b3d3fcd-a957-433c-a18f-65dad11ca2e0" status: 202 len: 0 microversion: 2.20 time: 0.227882 Aug 01 14:14:07.582047 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 323/634] 10.222.0.45 () {60 vars in 1457 bytes} [Mon Aug 1 14:14:07 2022] DELETE /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments/5b3d3fcd-a957-433c-a18f-65dad11ca2e0 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:14:07.596508 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5befc0e2-2395-4840-a8bb-3155d39e6e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:07.602037 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5befc0e2-2395-4840-a8bb-3155d39e6e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:07.614864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5befc0e2-2395-4840-a8bb-3155d39e6e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.615902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5befc0e2-2395-4840-a8bb-3155d39e6e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.617518 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5befc0e2-2395-4840-a8bb-3155d39e6e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.618455 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5befc0e2-2395-4840-a8bb-3155d39e6e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.672014 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5befc0e2-2395-4840-a8bb-3155d39e6e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083679 Aug 01 14:14:07.672981 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 312/635] 10.222.0.45 () {60 vars in 1343 bytes} [Mon Aug 1 14:14:07 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:14:08.695167 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d6f9e12f-ec4e-4288-8b0d-23d3bd089309 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:08.699567 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d6f9e12f-ec4e-4288-8b0d-23d3bd089309 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:08.711265 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d6f9e12f-ec4e-4288-8b0d-23d3bd089309 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:08.712578 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d6f9e12f-ec4e-4288-8b0d-23d3bd089309 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:08.714250 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d6f9e12f-ec4e-4288-8b0d-23d3bd089309 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:08.715332 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d6f9e12f-ec4e-4288-8b0d-23d3bd089309 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:08.779057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d6f9e12f-ec4e-4288-8b0d-23d3bd089309 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092388 Aug 01 14:14:08.780099 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 324/636] 10.222.0.45 () {60 vars in 1343 bytes} [Mon Aug 1 14:14:08 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:08.902891 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ea7a2e4f-3756-44ac-9d88-300a59800afe tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:08.903948 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ea7a2e4f-3756-44ac-9d88-300a59800afe tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:08.917892 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ea7a2e4f-3756-44ac-9d88-300a59800afe tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:08.918836 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ea7a2e4f-3756-44ac-9d88-300a59800afe tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:08.921039 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ea7a2e4f-3756-44ac-9d88-300a59800afe tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:08.921528 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ea7a2e4f-3756-44ac-9d88-300a59800afe tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:08.975593 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ea7a2e4f-3756-44ac-9d88-300a59800afe tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:14:09.091839 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ea7a2e4f-3756-44ac-9d88-300a59800afe tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "DELETE /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 204 len: 0 microversion: 2.20 time: 0.196387 Aug 01 14:14:09.096807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 313/637] 10.222.0.45 () {60 vars in 1280 bytes} [Mon Aug 1 14:14:08 2022] DELETE /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:14:09.103837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:09.104915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:09.112330 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:09.112949 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:09.113862 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:09.114462 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:09.305023 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:09.315512 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:09.317612 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:09.318865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3c32341e-bc13-4dc8-8ff6-3c3961d554a9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.220996 Aug 01 14:14:09.319463 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 325/638] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:09 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:14:10.349568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:10.351572 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:10.362174 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:10.363210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:10.373569 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:10.374284 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:10.598473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:10.611346 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:10.613091 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:10.614473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ff076f29-b9eb-4a85-b213-ecba47f07f21 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.271914 Aug 01 14:14:10.615170 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 314/639] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:10 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:11.657991 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:11.659116 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:11.671932 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:11.672647 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:11.674188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:11.675147 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:12.418376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:12.428882 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:12.430659 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:12.432117 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b9234434-3e28-47e3-8ba9-7ba695008155 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1725 microversion: 2.20 time: 0.781600 Aug 01 14:14:12.432884 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 326/640] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:11 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1725 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:13.459665 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:13.462611 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:13.471504 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:13.472596 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:13.473505 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:13.474585 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:13.496971 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-ed4c7f39-9ce1-4f43-a09f-290242df46b8 req-9d643ead-8e57-445d-8f33-f44d1c0bdefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446cfa38-0982-47b2-8e3f-a44a35257447", "name": "network-vif-deleted", "tag": "3c265e4a-7314-4d99-a248-2eb055ab90c0"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:13.523723 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ed4c7f39-9ce1-4f43-a09f-290242df46b8 req-9d643ead-8e57-445d-8f33-f44d1c0bdefd service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:13.525031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ed4c7f39-9ce1-4f43-a09f-290242df46b8 req-9d643ead-8e57-445d-8f33-f44d1c0bdefd service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:13.554605 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-ed4c7f39-9ce1-4f43-a09f-290242df46b8 req-9d643ead-8e57-445d-8f33-f44d1c0bdefd service nova] Creating event network-vif-deleted:3c265e4a-7314-4d99-a248-2eb055ab90c0 for instance 446cfa38-0982-47b2-8e3f-a44a35257447 on hv-cinder-84517 Aug 01 14:14:13.564970 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-ed4c7f39-9ce1-4f43-a09f-290242df46b8 req-9d643ead-8e57-445d-8f33-f44d1c0bdefd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081874 Aug 01 14:14:13.566559 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 327/641] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:13.647789 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:13.663980 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:13.668071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:13.671018 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bf9954d5-f872-45fe-a447-b614ae21b5a2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 200 len: 1657 microversion: 2.20 time: 0.215747 Aug 01 14:14:13.673120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 315/642] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:13 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 1657 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:14.700333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:14.702773 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:14.715006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:14.716151 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:14.717944 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:14.718674 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:14.750399 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] HTTP exception thrown: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Request method failure captured: Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 HTTP/1.1 Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi597El6IZaJp30kBgZIIWotHVfYK5X0V0t7lE7acoVFaLM4W1P6-l2UQFUyBpH11BmZ3wTYD860Lgqboy80r4mAFDW2pRd-9vEvfSY0--uV8TwbTsdQ5rE_XyME9cbGTrKkFmgtC71CCKrpxC31Pyy-GEK4EuFrgIR9zM4fM85MBEo38 Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:14:14.752936 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86a28aa09db413593b6047d4cbd0559", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86a28aa09db413593b6047d4cbd0559"}]}] Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 403896b926a1445b9895dc2d8d21854f Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:14:14.754850 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '446cfa38-0982-47b2-8e3f-a44a35257447'} Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:14:14.755863 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:14:14.757346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.760540 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Returning 404 to user: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:14:14.761691 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ced7e619-9801-4661-80ef-ef421aacf0cd tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 404 len: 111 microversion: 2.20 time: 0.070019 Aug 01 14:14:14.762535 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 328/643] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:14 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:14:14.780596 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-26577f32-324a-40fe-bd95-382fd45b3cf3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '.version_select at 0x7fc57a24b040>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:14.821729 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-26577f32-324a-40fe-bd95-382fd45b3cf3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102070334" status: 204 len: 0 microversion: 2.20 time: 0.050332 Aug 01 14:14:14.828920 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 316/644] 10.222.0.45 () {60 vars in 1262 bytes} [Mon Aug 1 14:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102070334 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:14:15.951573 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-90c27ccf-89c6-4211-8dc0-e1bf9a26a624 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'create', calling method: .version_select at 0x7fc5796b44c0>, body: {"keypair": {"name": "tempest-keypair-153954601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsnmaahI3t0fj6qJ8fddG+1C1UkR5ylaMIPWpPNcnPn7Y94CYQr3Ux1foUL5DnsIoewEZSSYlWXAPDD54Fbf6dNOikLcAVpbiRmtgqfLy5CIW7hh+94ZxPjK3moaAbsLg=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:15.978689 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-90c27ccf-89c6-4211-8dc0-e1bf9a26a624 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Getting quotas for project c86a28aa09db413593b6047d4cbd0559. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:14:16.003047 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-90c27ccf-89c6-4211-8dc0-e1bf9a26a624 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Getting quotas for user 403896b926a1445b9895dc2d8d21854f and project c86a28aa09db413593b6047d4cbd0559. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:14:16.056670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-90c27ccf-89c6-4211-8dc0-e1bf9a26a624 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.111555 Aug 01 14:14:16.058222 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 329/645] 10.222.0.45 () {62 vars in 1200 bytes} [Mon Aug 1 14:14:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 14:14:19.512236 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-704870370", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "294e8be6-62c8-4d19-be24-df34926b9c6c"}], "security_groups": [{"name": "tempest-securitygroup--56792020"}], "key_name": "tempest-keypair-153954601", "user_data": "}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:19.654313 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] validate_networks() for [('294e8be6-62c8-4d19-be24-df34926b9c6c', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:14:20.610942 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:14:20.611826 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:14:20.613057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:14:20.613481 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:14:20.614571 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:14:20.631386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:20.632148 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:20.633750 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:20.634870 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:20.672631 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Getting quotas for project c86a28aa09db413593b6047d4cbd0559. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:14:20.681875 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Getting quotas for user 403896b926a1445b9895dc2d8d21854f and project c86a28aa09db413593b6047d4cbd0559. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:14:20.702186 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:14:20.706650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:14:20.802599 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4ffaa65d-f6c6-46f1-8d4f-16c95013c394 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.295580 Aug 01 14:14:20.808002 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 317/646] 10.222.0.45 () {62 vars in 1188 bytes} [Mon Aug 1 14:14:19 2022] POST /compute/v2.1/servers => generated 400 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 01 14:14:20.816728 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-45d99fa5-21d6-4e43-9131-ed3f68f8c43a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:20.817622 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-45d99fa5-21d6-4e43-9131-ed3f68f8c43a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:20.901658 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-45d99fa5-21d6-4e43-9131-ed3f68f8c43a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:20.915233 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-45d99fa5-21d6-4e43-9131-ed3f68f8c43a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:20.918414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-45d99fa5-21d6-4e43-9131-ed3f68f8c43a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:20.920524 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-45d99fa5-21d6-4e43-9131-ed3f68f8c43a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1280 microversion: 2.20 time: 0.108609 Aug 01 14:14:20.921575 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 330/647] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:20 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1280 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:14:21.957845 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:21.958830 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:21.967789 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:21.968596 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:21.970023 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:21.970781 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:22.068842 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:22.082771 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:22.083517 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:22.085010 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-7bccae58-eef4-4a64-b86d-587752e5a884 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1332 microversion: 2.20 time: 0.132115 Aug 01 14:14:22.085807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 318/648] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:21 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:14:23.137833 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:23.138849 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:23.149160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:23.149758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:23.150625 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:23.151130 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:23.241072 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:23.260352 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:23.262419 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:23.263609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e6760427-90dd-4cb0-bc2d-02a194d83580 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1338 microversion: 2.20 time: 0.133987 Aug 01 14:14:23.264194 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 331/649] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:23 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1338 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:24.147985 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-5917e0c8-e014-4f41-977f-e441ad1b9e40 req-ced25db8-fd75-455f-a1ef-2b30687ac7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2880642-059e-4718-b9ed-becd8b1dad8c", "tag": "6f4bdd7e-2b10-4789-8e67-555594e488b6"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:24.170804 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-5917e0c8-e014-4f41-977f-e441ad1b9e40 req-ced25db8-fd75-455f-a1ef-2b30687ac7ce service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:24.171525 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-5917e0c8-e014-4f41-977f-e441ad1b9e40 req-ced25db8-fd75-455f-a1ef-2b30687ac7ce service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:24.191166 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-5917e0c8-e014-4f41-977f-e441ad1b9e40 req-ced25db8-fd75-455f-a1ef-2b30687ac7ce service nova] Creating event network-changed:6f4bdd7e-2b10-4789-8e67-555594e488b6 for instance a2880642-059e-4718-b9ed-becd8b1dad8c on hv-cinder-84517 Aug 01 14:14:24.200094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-5917e0c8-e014-4f41-977f-e441ad1b9e40 req-ced25db8-fd75-455f-a1ef-2b30687ac7ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058419 Aug 01 14:14:24.201360 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 319/650] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:24.291323 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:24.292247 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:24.303639 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:24.304590 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:24.306097 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:24.306990 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:24.583409 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:24.596818 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:24.599580 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:24.601492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5d593a8e-dbb9-4f5d-858c-60873a875125 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1404 microversion: 2.20 time: 0.317052 Aug 01 14:14:24.602360 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 332/651] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:24 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1404 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:25.174784 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-39271a61-f9ee-4b81-8a9a-57e8f1318141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:25.175432 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-39271a61-f9ee-4b81-8a9a-57e8f1318141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:25.183935 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-39271a61-f9ee-4b81-8a9a-57e8f1318141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:25.184608 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-39271a61-f9ee-4b81-8a9a-57e8f1318141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:25.185402 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-39271a61-f9ee-4b81-8a9a-57e8f1318141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:25.185843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-39271a61-f9ee-4b81-8a9a-57e8f1318141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:25.212262 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-39271a61-f9ee-4b81-8a9a-57e8f1318141 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/ips" status: 200 len: 146 microversion: 2.1 time: 0.041704 Aug 01 14:14:25.212933 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 320/652] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:14:25 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:25.639040 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:25.640242 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:25.652368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:25.652982 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:25.654059 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:25.654771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:25.938019 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:25.949003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:25.950880 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:25.952409 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d6cabe77-d2f4-4a19-89d8-0ee3fd39cb3c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1404 microversion: 2.20 time: 0.321433 Aug 01 14:14:25.953815 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 333/653] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:25 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1404 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:26.671439 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-547364bc-8e36-41fc-a89f-58f909e8a6ed tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "480e89c3-ed1a-4749-8fc6-fc486a811948"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:26.674623 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-547364bc-8e36-41fc-a89f-58f909e8a6ed tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:26.690108 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-547364bc-8e36-41fc-a89f-58f909e8a6ed tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:26.692658 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-547364bc-8e36-41fc-a89f-58f909e8a6ed tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:26.692658 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-547364bc-8e36-41fc-a89f-58f909e8a6ed tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:26.693326 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-547364bc-8e36-41fc-a89f-58f909e8a6ed tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:26.872314 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-df460f2f-8817-4aa9-ad59-d2e1c6f47eae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:26.873230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-df460f2f-8817-4aa9-ad59-d2e1c6f47eae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:26.882185 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df460f2f-8817-4aa9-ad59-d2e1c6f47eae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:26.882952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df460f2f-8817-4aa9-ad59-d2e1c6f47eae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:26.884329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df460f2f-8817-4aa9-ad59-d2e1c6f47eae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:26.885491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df460f2f-8817-4aa9-ad59-d2e1c6f47eae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:26.994253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-df460f2f-8817-4aa9-ad59-d2e1c6f47eae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lazy-loading 'services' on Instance uuid b69e5d2d-0483-4373-aa71-ea2305f287d3 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:14:27.091831 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-df460f2f-8817-4aa9-ad59-d2e1c6f47eae tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments/d231e51d-b788-42cf-b91f-a29fc26fa865" status: 202 len: 0 microversion: 2.1 time: 0.224501 Aug 01 14:14:27.092629 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 334/654] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:14:26 2022] DELETE /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments/d231e51d-b788-42cf-b91f-a29fc26fa865 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:14:27.099485 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:27.100467 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:27.102810 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:27.109757 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-547364bc-8e36-41fc-a89f-58f909e8a6ed tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442611 Aug 01 14:14:27.110430 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 321/655] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:14:26 2022] POST /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:14:27.110699 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:27.111242 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:27.112137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:27.112982 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:27.124131 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-e200bf96-5974-4d22-8f11-d873601dd2d8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:27.124131 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-e200bf96-5974-4d22-8f11-d873601dd2d8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:27.131850 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e200bf96-5974-4d22-8f11-d873601dd2d8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:27.132710 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e200bf96-5974-4d22-8f11-d873601dd2d8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:27.133759 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e200bf96-5974-4d22-8f11-d873601dd2d8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:27.134402 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e200bf96-5974-4d22-8f11-d873601dd2d8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:27.193831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-e200bf96-5974-4d22-8f11-d873601dd2d8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081294 Aug 01 14:14:27.197560 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 322/656] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:27 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:27.335798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:27.346269 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:27.347800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:27.349103 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cc28d4a8-600a-43e0-8ae6-909e783f428f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1404 microversion: 2.20 time: 0.255198 Aug 01 14:14:27.349744 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 335/657] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:27 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1404 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:28.208823 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-968cab44-6165-429d-ae7b-62e1c13a5655 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:28.211328 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-968cab44-6165-429d-ae7b-62e1c13a5655 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:28.213942 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:28.219264 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-968cab44-6165-429d-ae7b-62e1c13a5655 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:28.219757 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-968cab44-6165-429d-ae7b-62e1c13a5655 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:28.220548 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-968cab44-6165-429d-ae7b-62e1c13a5655 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:28.220971 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-968cab44-6165-429d-ae7b-62e1c13a5655 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:28.265070 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-968cab44-6165-429d-ae7b-62e1c13a5655 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061551 Aug 01 14:14:28.267043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 323/658] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:28 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:28.374485 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:28.375491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:28.383097 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:28.383537 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:28.384318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:28.384776 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:28.528777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:28.538252 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:28.540542 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:28.542951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-87c2a9eb-d1d3-41a3-908f-b33379d9a8b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1404 microversion: 2.20 time: 0.172612 Aug 01 14:14:28.550351 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 336/659] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:28 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:29.278708 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3d8c977c-a156-4abf-af29-8409c7805d30 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:29.280772 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3d8c977c-a156-4abf-af29-8409c7805d30 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:29.288243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3d8c977c-a156-4abf-af29-8409c7805d30 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:29.288709 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3d8c977c-a156-4abf-af29-8409c7805d30 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:29.289586 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3d8c977c-a156-4abf-af29-8409c7805d30 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:29.290017 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3d8c977c-a156-4abf-af29-8409c7805d30 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:29.323875 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3d8c977c-a156-4abf-af29-8409c7805d30 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049265 Aug 01 14:14:29.324530 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 324/660] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:29 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:29.569149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:29.570544 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:29.580043 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:29.580662 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:29.581681 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:29.582212 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:29.757479 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:29.776155 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:29.778208 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:29.780002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-078cf16b-9d1f-490e-9a02-3ed5f81d2e45 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1404 microversion: 2.20 time: 0.217652 Aug 01 14:14:29.780710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 337/661] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:29 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:30.337383 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9e27bde3-e66e-4827-ab96-752dd4150285 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:30.339558 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-9e27bde3-e66e-4827-ab96-752dd4150285 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:30.346597 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9e27bde3-e66e-4827-ab96-752dd4150285 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:30.347042 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9e27bde3-e66e-4827-ab96-752dd4150285 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:30.347815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9e27bde3-e66e-4827-ab96-752dd4150285 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:30.348242 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9e27bde3-e66e-4827-ab96-752dd4150285 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:30.381435 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9e27bde3-e66e-4827-ab96-752dd4150285 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048439 Aug 01 14:14:30.382066 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 325/662] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:30 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:30.703170 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-2811e431-eeb8-4bf5-9298-5c3b013aecae req-ea7957be-decc-447c-8598-c3792af54033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2880642-059e-4718-b9ed-becd8b1dad8c", "name": "network-vif-plugged", "status": "completed", "tag": "6f4bdd7e-2b10-4789-8e67-555594e488b6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:30.713476 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-2811e431-eeb8-4bf5-9298-5c3b013aecae req-ea7957be-decc-447c-8598-c3792af54033 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:30.713924 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-2811e431-eeb8-4bf5-9298-5c3b013aecae req-ea7957be-decc-447c-8598-c3792af54033 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:30.728490 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-2811e431-eeb8-4bf5-9298-5c3b013aecae req-ea7957be-decc-447c-8598-c3792af54033 service nova] Creating event network-vif-plugged:6f4bdd7e-2b10-4789-8e67-555594e488b6 for instance a2880642-059e-4718-b9ed-becd8b1dad8c on hv-cinder-84517 Aug 01 14:14:30.733637 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-2811e431-eeb8-4bf5-9298-5c3b013aecae req-ea7957be-decc-447c-8598-c3792af54033 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205408 Aug 01 14:14:30.734276 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 338/663] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:30.809040 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:30.810094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:30.813648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:30.815132 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=6 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:30.825986 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:30.826802 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:30.828265 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:30.829065 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:31.073755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:31.076253 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:31.085460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:31.087017 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:31.088198 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-48367b0c-45fd-4607-a4f3-ed597354611d tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1404 microversion: 2.20 time: 0.287625 Aug 01 14:14:31.088797 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 326/664] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:30 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1404 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:31.390428 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:31.394868 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7fc8fcf4-3940-4177-b771-a611825286f8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:31.397298 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7fc8fcf4-3940-4177-b771-a611825286f8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:31.404657 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7fc8fcf4-3940-4177-b771-a611825286f8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:31.405097 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7fc8fcf4-3940-4177-b771-a611825286f8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:31.405872 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7fc8fcf4-3940-4177-b771-a611825286f8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:31.406297 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7fc8fcf4-3940-4177-b771-a611825286f8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:31.438071 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7fc8fcf4-3940-4177-b771-a611825286f8 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048541 Aug 01 14:14:31.438703 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 339/665] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:31 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:32.112904 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:32.113793 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:32.124686 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:32.125497 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:32.126928 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:32.127721 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:32.291411 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:32.301160 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:32.302839 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:32.304006 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-20b4ddfa-4480-44c9-850d-dfb0f535c5e0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1404 microversion: 2.20 time: 0.195526 Aug 01 14:14:32.304620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 327/666] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:32 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1404 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:32.456390 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e57aab2e-557b-4a0c-acf9-44a95edf7df1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:32.460228 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e57aab2e-557b-4a0c-acf9-44a95edf7df1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:32.471455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e57aab2e-557b-4a0c-acf9-44a95edf7df1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:32.472250 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e57aab2e-557b-4a0c-acf9-44a95edf7df1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:32.473689 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e57aab2e-557b-4a0c-acf9-44a95edf7df1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:32.474455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e57aab2e-557b-4a0c-acf9-44a95edf7df1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:32.479296 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:32.532514 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e57aab2e-557b-4a0c-acf9-44a95edf7df1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083572 Aug 01 14:14:32.533962 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 340/667] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:32 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:33.327568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:33.328168 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:33.335989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:33.336504 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:33.337287 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:33.337728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:33.488754 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:33.498281 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:33.500427 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:33.501744 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-e284988a-32f0-41e4-9b03-ed63bd4fc6c1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1596 microversion: 2.20 time: 0.178301 Aug 01 14:14:33.502311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 328/668] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:33 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1596 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:33.524357 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-09448f9f-06ca-44df-8456-1b9625f7ebd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:33.524966 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-09448f9f-06ca-44df-8456-1b9625f7ebd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:33.531925 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09448f9f-06ca-44df-8456-1b9625f7ebd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:33.532437 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09448f9f-06ca-44df-8456-1b9625f7ebd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:33.533221 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09448f9f-06ca-44df-8456-1b9625f7ebd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:33.533650 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09448f9f-06ca-44df-8456-1b9625f7ebd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:33.550475 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-07262591-2c9d-4513-9720-ac12668fed9a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:33.553675 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-07262591-2c9d-4513-9720-ac12668fed9a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:33.561902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07262591-2c9d-4513-9720-ac12668fed9a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:33.562435 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07262591-2c9d-4513-9720-ac12668fed9a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:33.563195 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07262591-2c9d-4513-9720-ac12668fed9a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:33.563729 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07262591-2c9d-4513-9720-ac12668fed9a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:33.602128 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-07262591-2c9d-4513-9720-ac12668fed9a tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059596 Aug 01 14:14:33.602952 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 329/669] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:33 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:14:33.625926 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-09448f9f-06ca-44df-8456-1b9625f7ebd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105708 Aug 01 14:14:33.626524 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 341/670] 10.222.0.45 () {60 vars in 1316 bytes} [Mon Aug 1 14:14:33 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:14:34.616110 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6fdd0876-cd2f-4b10-862e-075918352be1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:34.618459 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6fdd0876-cd2f-4b10-862e-075918352be1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:34.626329 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6fdd0876-cd2f-4b10-862e-075918352be1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.626899 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6fdd0876-cd2f-4b10-862e-075918352be1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.627991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6fdd0876-cd2f-4b10-862e-075918352be1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.628647 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6fdd0876-cd2f-4b10-862e-075918352be1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.672653 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6fdd0876-cd2f-4b10-862e-075918352be1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061239 Aug 01 14:14:34.673535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 330/671] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:34 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 14:14:34.742249 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-09d442c3-b7b3-44ce-be59-b3c9e7770316 req-7fcef5e2-4a72-4522-96bb-14e636e44926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2880642-059e-4718-b9ed-becd8b1dad8c", "tag": "6f4bdd7e-2b10-4789-8e67-555594e488b6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:34.764325 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-09d442c3-b7b3-44ce-be59-b3c9e7770316 req-7fcef5e2-4a72-4522-96bb-14e636e44926 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.764325 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-09d442c3-b7b3-44ce-be59-b3c9e7770316 req-7fcef5e2-4a72-4522-96bb-14e636e44926 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.766385 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-09d442c3-b7b3-44ce-be59-b3c9e7770316 req-7fcef5e2-4a72-4522-96bb-14e636e44926 service nova] Creating event network-changed:6f4bdd7e-2b10-4789-8e67-555594e488b6 for instance a2880642-059e-4718-b9ed-becd8b1dad8c on hv-cinder-84517 Aug 01 14:14:34.774750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-09d442c3-b7b3-44ce-be59-b3c9e7770316 req-7fcef5e2-4a72-4522-96bb-14e636e44926 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036990 Aug 01 14:14:34.780591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 342/672] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:34.793251 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2409a212-7078-4f26-9663-93f26deb4c68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:34.794100 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2409a212-7078-4f26-9663-93f26deb4c68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:34.800956 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2409a212-7078-4f26-9663-93f26deb4c68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.801317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2409a212-7078-4f26-9663-93f26deb4c68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.802333 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2409a212-7078-4f26-9663-93f26deb4c68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.802788 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2409a212-7078-4f26-9663-93f26deb4c68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.833119 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2409a212-7078-4f26-9663-93f26deb4c68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:14:34.850166 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-70662110-081c-43db-b240-8f32f2ebbaae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:34.856305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-70662110-081c-43db-b240-8f32f2ebbaae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:34.864061 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70662110-081c-43db-b240-8f32f2ebbaae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.864848 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70662110-081c-43db-b240-8f32f2ebbaae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.865820 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70662110-081c-43db-b240-8f32f2ebbaae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.867036 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70662110-081c-43db-b240-8f32f2ebbaae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.905930 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-70662110-081c-43db-b240-8f32f2ebbaae tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072058 Aug 01 14:14:34.907124 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 343/673] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:34 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:34.919737 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3e67d90d-d4c9-48d6-8234-9b648e3ec588 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:34.920561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3e67d90d-d4c9-48d6-8234-9b648e3ec588 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:34.930032 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3e67d90d-d4c9-48d6-8234-9b648e3ec588 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.931365 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3e67d90d-d4c9-48d6-8234-9b648e3ec588 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.933964 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3e67d90d-d4c9-48d6-8234-9b648e3ec588 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.948608 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3e67d90d-d4c9-48d6-8234-9b648e3ec588 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.957350 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2409a212-7078-4f26-9663-93f26deb4c68 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 204 len: 0 microversion: 2.1 time: 0.167374 Aug 01 14:14:34.959251 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 331/674] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:14:34 2022] DELETE /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:14:34.975144 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2217a5d3-0ec3-4ed0-840d-fe6d67598c59 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:34.975857 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2217a5d3-0ec3-4ed0-840d-fe6d67598c59 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:34.987007 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2217a5d3-0ec3-4ed0-840d-fe6d67598c59 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.987720 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2217a5d3-0ec3-4ed0-840d-fe6d67598c59 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.989104 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2217a5d3-0ec3-4ed0-840d-fe6d67598c59 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:34.990960 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2217a5d3-0ec3-4ed0-840d-fe6d67598c59 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:34.996195 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3e67d90d-d4c9-48d6-8234-9b648e3ec588 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/480e89c3-ed1a-4749-8fc6-fc486a811948" status: 200 len: 194 microversion: 2.1 time: 0.082225 Aug 01 14:14:35.012374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 344/675] 10.222.0.45 () {58 vars in 1413 bytes} [Mon Aug 1 14:14:34 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/480e89c3-ed1a-4749-8fc6-fc486a811948 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:35.198700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2217a5d3-0ec3-4ed0-840d-fe6d67598c59 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:35.214136 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2217a5d3-0ec3-4ed0-840d-fe6d67598c59 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1691 microversion: 2.1 time: 0.250507 Aug 01 14:14:35.228174 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 332/676] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:34 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1691 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:36.238747 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5596baad-63bc-4e4e-bcdb-0547e7836002 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:36.239468 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5596baad-63bc-4e4e-bcdb-0547e7836002 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:36.246493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5596baad-63bc-4e4e-bcdb-0547e7836002 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:36.246935 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5596baad-63bc-4e4e-bcdb-0547e7836002 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:36.247717 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5596baad-63bc-4e4e-bcdb-0547e7836002 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:36.248151 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5596baad-63bc-4e4e-bcdb-0547e7836002 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:36.391724 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5596baad-63bc-4e4e-bcdb-0547e7836002 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:36.405406 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5596baad-63bc-4e4e-bcdb-0547e7836002 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1691 microversion: 2.1 time: 0.170992 Aug 01 14:14:36.406468 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 345/677] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:36 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:36.466911 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-fb2ed754-08c8-4a5c-9419-4cfda2dafa9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40e3c2aa-db60-4796-a5da-09b4060f6ece"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:36.469505 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-fb2ed754-08c8-4a5c-9419-4cfda2dafa9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:36.476539 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb2ed754-08c8-4a5c-9419-4cfda2dafa9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:36.477019 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb2ed754-08c8-4a5c-9419-4cfda2dafa9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:36.477831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb2ed754-08c8-4a5c-9419-4cfda2dafa9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:36.478311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb2ed754-08c8-4a5c-9419-4cfda2dafa9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:37.440820 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c0dbdd26-87dd-4972-806a-5c614d4a0a32 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:37.441502 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c0dbdd26-87dd-4972-806a-5c614d4a0a32 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:37.448454 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0dbdd26-87dd-4972-806a-5c614d4a0a32 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:37.448953 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0dbdd26-87dd-4972-806a-5c614d4a0a32 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:37.449801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0dbdd26-87dd-4972-806a-5c614d4a0a32 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:37.450368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c0dbdd26-87dd-4972-806a-5c614d4a0a32 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:37.625735 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c0dbdd26-87dd-4972-806a-5c614d4a0a32 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:37.634247 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c0dbdd26-87dd-4972-806a-5c614d4a0a32 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1691 microversion: 2.1 time: 0.197303 Aug 01 14:14:37.634846 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 346/678] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:37 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:38.161624 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-fb2ed754-08c8-4a5c-9419-4cfda2dafa9d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "POST /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.698677 Aug 01 14:14:38.162906 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 333/679] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:14:36 2022] POST /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments => generated 194 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:38.659144 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b537cc0e-465f-47e3-9a21-6ad6c379f524 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:38.659694 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b537cc0e-465f-47e3-9a21-6ad6c379f524 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:38.667581 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b537cc0e-465f-47e3-9a21-6ad6c379f524 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:38.668026 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b537cc0e-465f-47e3-9a21-6ad6c379f524 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:38.668800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b537cc0e-465f-47e3-9a21-6ad6c379f524 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:38.669431 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b537cc0e-465f-47e3-9a21-6ad6c379f524 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:39.198204 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b537cc0e-465f-47e3-9a21-6ad6c379f524 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:39.206407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b537cc0e-465f-47e3-9a21-6ad6c379f524 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 200 len: 1691 microversion: 2.1 time: 0.551482 Aug 01 14:14:39.207427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 347/680] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:38 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 1691 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:39.699357 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-d730cb35-96d3-4d02-bdcb-d7f619924cb6 req-05808256-9f68-4559-87cd-fa49b2f4bfbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69e5d2d-0483-4373-aa71-ea2305f287d3", "name": "network-vif-deleted", "tag": "03542f14-88d5-4bf6-9c7d-0dcbe18589a5"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:39.714321 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-d730cb35-96d3-4d02-bdcb-d7f619924cb6 req-05808256-9f68-4559-87cd-fa49b2f4bfbb service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:39.714769 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-d730cb35-96d3-4d02-bdcb-d7f619924cb6 req-05808256-9f68-4559-87cd-fa49b2f4bfbb service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:39.727864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-d730cb35-96d3-4d02-bdcb-d7f619924cb6 req-05808256-9f68-4559-87cd-fa49b2f4bfbb service nova] Creating event network-vif-deleted:03542f14-88d5-4bf6-9c7d-0dcbe18589a5 for instance b69e5d2d-0483-4373-aa71-ea2305f287d3 on hv-cinder-84517 Aug 01 14:14:39.733977 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-d730cb35-96d3-4d02-bdcb-d7f619924cb6 req-05808256-9f68-4559-87cd-fa49b2f4bfbb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041838 Aug 01 14:14:39.735950 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 334/681] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:14:40.229155 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:40.229991 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: b69e5d2d-0483-4373-aa71-ea2305f287d3] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:40.237018 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:40.237604 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:40.238571 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:40.239076 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:40.254295 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] HTTP exception thrown: Instance b69e5d2d-0483-4373-aa71-ea2305f287d3 could not be found. Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Request method failure captured: Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 HTTP/1.1 Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595nBvngFLvXmcxyqRbq0vAZso55lRqZPdXo9mG7MzO7BEgpjGUJXmDJ-Wrlr5gSX2E3O49ldx2NkMHkhpNVEedoqx6r8Ucd5xA2QvZhi4cW0ovwwW2Ary3iU0xyJcDZxg2MxyAC0etakIhVNhyVB6hrmON2qyAVhF4w9-kPyJ8xt6U Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:14:40.256405 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e85f3e6c18ae4466a1dc3e6464aa18e6", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}] Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a3e93dfa85244133b1641a431994b47f Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance b69e5d2d-0483-4373-aa71-ea2305f287d3 could not be found. Aug 01 14:14:40.258231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': 'b69e5d2d-0483-4373-aa71-ea2305f287d3'} Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69e5d2d-0483-4373-aa71-ea2305f287d3 could not be found. Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:14:40.259133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69e5d2d-0483-4373-aa71-ea2305f287d3 could not be found. Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69e5d2d-0483-4373-aa71-ea2305f287d3 could not be found. Aug 01 14:14:40.262057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:40.263837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Returning 404 to user: Instance b69e5d2d-0483-4373-aa71-ea2305f287d3 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:14:40.263837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-440bc203-fd5a-458f-a138-b96fa213007b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3" status: 404 len: 111 microversion: 2.1 time: 0.034303 Aug 01 14:14:40.264334 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 348/682] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:40 2022] GET /compute/v2.1/servers/b69e5d2d-0483-4373-aa71-ea2305f287d3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:14:40.270152 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3ccac8b1-bb0d-40ba-b8d3-aa273c9ec65d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '.version_select at 0x7fc579589ca0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:40.295418 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3ccac8b1-bb0d-40ba-b8d3-aa273c9ec65d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620377446" status: 202 len: 0 microversion: 2.1 time: 0.029725 Aug 01 14:14:40.296076 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 335/683] 10.222.0.45 () {58 vars in 1221 bytes} [Mon Aug 1 14:14:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620377446 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:14:43.311073 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9daefb72-027e-4af5-8ad8-b08e43973406 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:43.311698 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9daefb72-027e-4af5-8ad8-b08e43973406 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:43.319812 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9daefb72-027e-4af5-8ad8-b08e43973406 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:43.320305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9daefb72-027e-4af5-8ad8-b08e43973406 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:43.321105 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9daefb72-027e-4af5-8ad8-b08e43973406 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:43.321555 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9daefb72-027e-4af5-8ad8-b08e43973406 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:43.359690 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9daefb72-027e-4af5-8ad8-b08e43973406 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:14:43.454931 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9daefb72-027e-4af5-8ad8-b08e43973406 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 204 len: 0 microversion: 2.1 time: 0.147795 Aug 01 14:14:43.456811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 349/684] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:14:43 2022] DELETE /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:14:43.466139 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-73682734-a2d9-4897-b3fc-492a3df5a507 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:43.466968 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-73682734-a2d9-4897-b3fc-492a3df5a507 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:43.474433 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-73682734-a2d9-4897-b3fc-492a3df5a507 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:43.474879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-73682734-a2d9-4897-b3fc-492a3df5a507 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:43.475668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-73682734-a2d9-4897-b3fc-492a3df5a507 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:43.476104 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-73682734-a2d9-4897-b3fc-492a3df5a507 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:43.651766 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-73682734-a2d9-4897-b3fc-492a3df5a507 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:43.664753 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-73682734-a2d9-4897-b3fc-492a3df5a507 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1507 microversion: 2.1 time: 0.203510 Aug 01 14:14:43.665320 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 336/685] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:43 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:14:44.686268 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-207c8785-115c-4543-8929-2353237a43fc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:44.686995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-207c8785-115c-4543-8929-2353237a43fc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:44.693800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-207c8785-115c-4543-8929-2353237a43fc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:44.694268 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-207c8785-115c-4543-8929-2353237a43fc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:44.695031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-207c8785-115c-4543-8929-2353237a43fc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:44.695451 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-207c8785-115c-4543-8929-2353237a43fc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:44.836796 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-207c8785-115c-4543-8929-2353237a43fc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:44.845383 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-207c8785-115c-4543-8929-2353237a43fc tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1507 microversion: 2.1 time: 0.163349 Aug 01 14:14:44.846783 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 350/686] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:44 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:45.265854 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0366e7d7-5392-4c81-b4d1-ba480236047b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:45.266521 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0366e7d7-5392-4c81-b4d1-ba480236047b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:45.274325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0366e7d7-5392-4c81-b4d1-ba480236047b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:45.274788 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0366e7d7-5392-4c81-b4d1-ba480236047b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:45.275683 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0366e7d7-5392-4c81-b4d1-ba480236047b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:45.276174 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0366e7d7-5392-4c81-b4d1-ba480236047b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:45.304729 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0366e7d7-5392-4c81-b4d1-ba480236047b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:14:45.385596 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0366e7d7-5392-4c81-b4d1-ba480236047b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 204 len: 0 microversion: 2.1 time: 0.124227 Aug 01 14:14:45.386427 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 337/687] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:14:45 2022] DELETE /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:14:45.394824 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bd297420-fbc7-439b-8289-60e283ee163d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:45.395435 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bd297420-fbc7-439b-8289-60e283ee163d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:45.401918 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd297420-fbc7-439b-8289-60e283ee163d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:45.402362 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd297420-fbc7-439b-8289-60e283ee163d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:45.403162 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd297420-fbc7-439b-8289-60e283ee163d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:45.403590 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd297420-fbc7-439b-8289-60e283ee163d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:45.549894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bd297420-fbc7-439b-8289-60e283ee163d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:45.558207 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bd297420-fbc7-439b-8289-60e283ee163d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1578 microversion: 2.1 time: 0.167274 Aug 01 14:14:45.558788 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 351/688] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:45 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:45.867887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-26748e2e-2302-40b4-b2fe-dd6c6a5d924d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:45.868633 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-26748e2e-2302-40b4-b2fe-dd6c6a5d924d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:45.874974 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-26748e2e-2302-40b4-b2fe-dd6c6a5d924d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:45.875410 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-26748e2e-2302-40b4-b2fe-dd6c6a5d924d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:45.876182 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-26748e2e-2302-40b4-b2fe-dd6c6a5d924d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:45.876630 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-26748e2e-2302-40b4-b2fe-dd6c6a5d924d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:46.093860 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-26748e2e-2302-40b4-b2fe-dd6c6a5d924d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:46.104585 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-26748e2e-2302-40b4-b2fe-dd6c6a5d924d tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1507 microversion: 2.1 time: 0.240937 Aug 01 14:14:46.105192 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 338/689] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:45 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:46.256929 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-6b50d2d7-d2f3-4f54-b2c3-9ad4d2bdd2bd req-b6fcdce5-2ef8-41ae-b28f-11fe99119f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa86ccd-b145-4025-88ba-1962fcddee29", "name": "network-vif-deleted", "tag": "7086f705-ac19-4c95-a617-0872f904d724"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:46.274340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-6b50d2d7-d2f3-4f54-b2c3-9ad4d2bdd2bd req-b6fcdce5-2ef8-41ae-b28f-11fe99119f6e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:46.275451 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-6b50d2d7-d2f3-4f54-b2c3-9ad4d2bdd2bd req-b6fcdce5-2ef8-41ae-b28f-11fe99119f6e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:46.297580 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-6b50d2d7-d2f3-4f54-b2c3-9ad4d2bdd2bd req-b6fcdce5-2ef8-41ae-b28f-11fe99119f6e service nova] Creating event network-vif-deleted:7086f705-ac19-4c95-a617-0872f904d724 for instance 2fa86ccd-b145-4025-88ba-1962fcddee29 on hv-cinder-84517 Aug 01 14:14:46.306801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-6b50d2d7-d2f3-4f54-b2c3-9ad4d2bdd2bd req-b6fcdce5-2ef8-41ae-b28f-11fe99119f6e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058140 Aug 01 14:14:46.307901 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 352/690] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:46.580848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f587b959-d5b0-48d8-8c05-a73e844d2ddb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:46.581460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f587b959-d5b0-48d8-8c05-a73e844d2ddb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:46.588583 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f587b959-d5b0-48d8-8c05-a73e844d2ddb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:46.589025 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f587b959-d5b0-48d8-8c05-a73e844d2ddb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:46.589798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f587b959-d5b0-48d8-8c05-a73e844d2ddb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:46.590225 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f587b959-d5b0-48d8-8c05-a73e844d2ddb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:46.761967 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f587b959-d5b0-48d8-8c05-a73e844d2ddb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:46.770145 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f587b959-d5b0-48d8-8c05-a73e844d2ddb tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1578 microversion: 2.1 time: 0.193287 Aug 01 14:14:46.770811 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 339/691] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:46 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1578 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:47.126230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:47.126855 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:47.133992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:47.134431 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:47.135200 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:47.135631 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:47.168426 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:47.168869 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:47.169318 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lazy-loading 'fault' on Instance uuid 2fa86ccd-b145-4025-88ba-1962fcddee29 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:14:47.212414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:47.221131 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9371a7e0-5da2-4df3-9721-8ff4c1b682d9 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 200 len: 1311 microversion: 2.1 time: 0.099142 Aug 01 14:14:47.221751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 353/692] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:47 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:47.796325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3c66d30c-ee9e-4f7a-ad3b-66982999c6d2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:47.797102 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3c66d30c-ee9e-4f7a-ad3b-66982999c6d2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:47.806509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c66d30c-ee9e-4f7a-ad3b-66982999c6d2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:47.806963 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c66d30c-ee9e-4f7a-ad3b-66982999c6d2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:47.807767 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c66d30c-ee9e-4f7a-ad3b-66982999c6d2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:47.808178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c66d30c-ee9e-4f7a-ad3b-66982999c6d2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:47.830659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:47.954303 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2193764e-5412-4fc7-9679-80e4d2dad63c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:47.956504 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2193764e-5412-4fc7-9679-80e4d2dad63c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:47.963315 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2193764e-5412-4fc7-9679-80e4d2dad63c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:47.963780 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2193764e-5412-4fc7-9679-80e4d2dad63c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:47.964588 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2193764e-5412-4fc7-9679-80e4d2dad63c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:47.965040 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2193764e-5412-4fc7-9679-80e4d2dad63c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:47.995627 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2193764e-5412-4fc7-9679-80e4d2dad63c tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045236 Aug 01 14:14:47.996190 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 354/693] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:47 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:48.086393 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3c66d30c-ee9e-4f7a-ad3b-66982999c6d2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:48.095338 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3c66d30c-ee9e-4f7a-ad3b-66982999c6d2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1578 microversion: 2.1 time: 0.303306 Aug 01 14:14:48.095937 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 340/694] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:47 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1578 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:48.140299 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7918ddda-598a-44fb-a0cf-f186ec455b61 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:48.140782 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7918ddda-598a-44fb-a0cf-f186ec455b61 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:48.147374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7918ddda-598a-44fb-a0cf-f186ec455b61 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.147811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7918ddda-598a-44fb-a0cf-f186ec455b61 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.148610 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7918ddda-598a-44fb-a0cf-f186ec455b61 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.149032 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7918ddda-598a-44fb-a0cf-f186ec455b61 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.200222 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7918ddda-598a-44fb-a0cf-f186ec455b61 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/480e89c3-ed1a-4749-8fc6-fc486a811948" status: 200 len: 194 microversion: 2.1 time: 0.063933 Aug 01 14:14:48.201137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 355/695] 10.222.0.45 () {58 vars in 1413 bytes} [Mon Aug 1 14:14:48 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/480e89c3-ed1a-4749-8fc6-fc486a811948 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:48.212083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-7892ce71-5aff-4877-823f-b42101295f09 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:48.212611 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-7892ce71-5aff-4877-823f-b42101295f09 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:48.220870 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7892ce71-5aff-4877-823f-b42101295f09 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.222478 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7892ce71-5aff-4877-823f-b42101295f09 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.223561 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7892ce71-5aff-4877-823f-b42101295f09 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.224220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-7892ce71-5aff-4877-823f-b42101295f09 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.243258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:48.244982 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 2fa86ccd-b145-4025-88ba-1962fcddee29] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:48.253001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.253713 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.254979 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.256615 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.285146 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] HTTP exception thrown: Instance 2fa86ccd-b145-4025-88ba-1962fcddee29 could not be found. Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Request method failure captured: Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 HTTP/1.1 Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595nBvngFLvXmcxyqRbq0vAZso55lRqZPdXo9mG7MzO7BEgpjGUJXmDJ-Wrlr5gSX2E3O49ldx2NkMHkhpNVEedoqx6r8Ucd5xA2QvZhi4cW0ovwwW2Ary3iU0xyJcDZxg2MxyAC0etakIhVNhyVB6hrmON2qyAVhF4w9-kPyJ8xt6U Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:14:48.290003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e85f3e6c18ae4466a1dc3e6464aa18e6", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}] Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a3e93dfa85244133b1641a431994b47f Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 2fa86ccd-b145-4025-88ba-1962fcddee29 could not be found. Aug 01 14:14:48.291896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '2fa86ccd-b145-4025-88ba-1962fcddee29'} Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa86ccd-b145-4025-88ba-1962fcddee29 could not be found. Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:14:48.293215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa86ccd-b145-4025-88ba-1962fcddee29 could not be found. Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa86ccd-b145-4025-88ba-1962fcddee29 could not be found. Aug 01 14:14:48.294915 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:48.296521 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Returning 404 to user: Instance 2fa86ccd-b145-4025-88ba-1962fcddee29 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:14:48.297314 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1a85e9dc-8820-41ef-b092-e2c5820aa02c tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29" status: 404 len: 111 microversion: 2.1 time: 0.056880 Aug 01 14:14:48.298680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 356/696] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:48 2022] GET /compute/v2.1/servers/2fa86ccd-b145-4025-88ba-1962fcddee29 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:14:48.308616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e4c25ad1-5801-49d6-be49-e657cc4ed6c1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:48.309255 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e4c25ad1-5801-49d6-be49-e657cc4ed6c1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:48.317486 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e4c25ad1-5801-49d6-be49-e657cc4ed6c1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.317882 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e4c25ad1-5801-49d6-be49-e657cc4ed6c1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.318673 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e4c25ad1-5801-49d6-be49-e657cc4ed6c1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.319279 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e4c25ad1-5801-49d6-be49-e657cc4ed6c1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.349679 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e4c25ad1-5801-49d6-be49-e657cc4ed6c1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:14:48.352188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:48.359336 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-7892ce71-5aff-4877-823f-b42101295f09 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lazy-loading 'services' on Instance uuid 462a7ad5-816c-49b1-a36b-84dc587c93ca {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:14:48.476008 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e4c25ad1-5801-49d6-be49-e657cc4ed6c1 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "DELETE /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 204 len: 0 microversion: 2.1 time: 0.172084 Aug 01 14:14:48.476642 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 357/697] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:14:48 2022] DELETE /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:14:48.491409 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1ad153b0-db62-4caa-8d46-049e169c7d8b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:48.491708 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-7892ce71-5aff-4877-823f-b42101295f09 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "DELETE /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/480e89c3-ed1a-4749-8fc6-fc486a811948" status: 202 len: 0 microversion: 2.1 time: 0.282710 Aug 01 14:14:48.493259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1ad153b0-db62-4caa-8d46-049e169c7d8b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:48.494607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 341/698] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:14:48 2022] DELETE /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/480e89c3-ed1a-4749-8fc6-fc486a811948 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:14:48.509834 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1ad153b0-db62-4caa-8d46-049e169c7d8b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.510404 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1ad153b0-db62-4caa-8d46-049e169c7d8b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.511475 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1ad153b0-db62-4caa-8d46-049e169c7d8b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.512225 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1ad153b0-db62-4caa-8d46-049e169c7d8b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.707664 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-b1a22d3b-58cb-4312-b58c-cb3c3ebfafdb req-4e123c44-a781-4aa3-aca7-426a1f11bdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7f31f9-adc0-4be6-92b9-0c2c99e14308", "name": "network-vif-deleted", "tag": "754c5fad-2162-4018-96e9-5a8df36d546e"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:48.720133 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-b1a22d3b-58cb-4312-b58c-cb3c3ebfafdb req-4e123c44-a781-4aa3-aca7-426a1f11bdf5 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:48.721081 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-b1a22d3b-58cb-4312-b58c-cb3c3ebfafdb req-4e123c44-a781-4aa3-aca7-426a1f11bdf5 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:48.737955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-b1a22d3b-58cb-4312-b58c-cb3c3ebfafdb req-4e123c44-a781-4aa3-aca7-426a1f11bdf5 service nova] Creating event network-vif-deleted:754c5fad-2162-4018-96e9-5a8df36d546e for instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 on hv-cinder-84517 Aug 01 14:14:48.746369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-b1a22d3b-58cb-4312-b58c-cb3c3ebfafdb req-4e123c44-a781-4aa3-aca7-426a1f11bdf5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043090 Aug 01 14:14:48.747711 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 342/699] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:14:48.766492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1ad153b0-db62-4caa-8d46-049e169c7d8b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:48.775974 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1ad153b0-db62-4caa-8d46-049e169c7d8b tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 0.293203 Aug 01 14:14:48.776463 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 358/700] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:48 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:49.123597 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6552bb14-7091-49b1-9c53-0ed4075782d6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:49.124823 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6552bb14-7091-49b1-9c53-0ed4075782d6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:49.151580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6552bb14-7091-49b1-9c53-0ed4075782d6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:49.152575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6552bb14-7091-49b1-9c53-0ed4075782d6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:49.154076 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6552bb14-7091-49b1-9c53-0ed4075782d6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:49.154813 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6552bb14-7091-49b1-9c53-0ed4075782d6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:49.266200 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6552bb14-7091-49b1-9c53-0ed4075782d6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:49.280563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6552bb14-7091-49b1-9c53-0ed4075782d6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1510 microversion: 2.1 time: 0.165869 Aug 01 14:14:49.281625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 343/701] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:49 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:49.802283 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7c68ed94-a52f-4f21-b04a-da238c8ab379 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:49.803682 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7c68ed94-a52f-4f21-b04a-da238c8ab379 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:49.815494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c68ed94-a52f-4f21-b04a-da238c8ab379 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:49.815909 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c68ed94-a52f-4f21-b04a-da238c8ab379 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:49.816730 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c68ed94-a52f-4f21-b04a-da238c8ab379 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:49.817168 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c68ed94-a52f-4f21-b04a-da238c8ab379 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:49.974069 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7c68ed94-a52f-4f21-b04a-da238c8ab379 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:49.982110 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7c68ed94-a52f-4f21-b04a-da238c8ab379 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 0.188151 Aug 01 14:14:49.982691 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 359/702] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:49 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:50.317082 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ffcec141-75ef-4a2c-836b-26bb1291790d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:50.317961 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ffcec141-75ef-4a2c-836b-26bb1291790d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:50.325366 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ffcec141-75ef-4a2c-836b-26bb1291790d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:50.325804 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ffcec141-75ef-4a2c-836b-26bb1291790d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:50.326611 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ffcec141-75ef-4a2c-836b-26bb1291790d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:50.327064 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ffcec141-75ef-4a2c-836b-26bb1291790d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:50.391979 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ffcec141-75ef-4a2c-836b-26bb1291790d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:50.401419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ffcec141-75ef-4a2c-836b-26bb1291790d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1510 microversion: 2.1 time: 0.088505 Aug 01 14:14:50.402027 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 344/703] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:50 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:51.003882 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7daede55-b3d3-4f25-8125-a835f23493bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:51.004593 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7daede55-b3d3-4f25-8125-a835f23493bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:51.011641 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7daede55-b3d3-4f25-8125-a835f23493bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.012090 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7daede55-b3d3-4f25-8125-a835f23493bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.012913 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7daede55-b3d3-4f25-8125-a835f23493bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.013344 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7daede55-b3d3-4f25-8125-a835f23493bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.243325 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7daede55-b3d3-4f25-8125-a835f23493bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e93dfa85244133b1641a431994b47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85f3e6c18ae4466a1dc3e6464aa18e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:51.251698 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7daede55-b3d3-4f25-8125-a835f23493bb tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 200 len: 1521 microversion: 2.1 time: 0.251791 Aug 01 14:14:51.252319 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 360/704] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:50 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:51.425977 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:51.426866 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:51.434152 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.434582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.435397 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.435837 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.470825 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.471266 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.471915 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lazy-loading 'fault' on Instance uuid 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:14:51.481155 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-a41e95e9-0e33-450b-ac32-a3288265308d req-b725edbd-2972-4d21-ab47-b1bdf32211a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36838f66-2529-4a98-88cd-4a0450c2aba5", "name": "network-vif-deleted", "tag": "6435f407-545f-4889-be82-4de3b791eeb8"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:51.491072 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a41e95e9-0e33-450b-ac32-a3288265308d req-b725edbd-2972-4d21-ab47-b1bdf32211a3 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.491507 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a41e95e9-0e33-450b-ac32-a3288265308d req-b725edbd-2972-4d21-ab47-b1bdf32211a3 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.503130 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-a41e95e9-0e33-450b-ac32-a3288265308d req-b725edbd-2972-4d21-ab47-b1bdf32211a3 service nova] Creating event network-vif-deleted:6435f407-545f-4889-be82-4de3b791eeb8 for instance 36838f66-2529-4a98-88cd-4a0450c2aba5 on hv-cinder-84517 Aug 01 14:14:51.508616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-a41e95e9-0e33-450b-ac32-a3288265308d req-b725edbd-2972-4d21-ab47-b1bdf32211a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Aug 01 14:14:51.509404 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 361/705] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:51.518323 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:51.527562 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-01f19f68-f0c5-4ee9-8bdf-a7d6dfce26f8 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 200 len: 1230 microversion: 2.1 time: 0.105874 Aug 01 14:14:51.537013 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 345/706] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:51 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:51.788393 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-de549af4-3655-4f6c-84f5-4fc7c4f8d961 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:51.789010 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-de549af4-3655-4f6c-84f5-4fc7c4f8d961 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:51.795694 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de549af4-3655-4f6c-84f5-4fc7c4f8d961 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.796144 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de549af4-3655-4f6c-84f5-4fc7c4f8d961 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.796959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de549af4-3655-4f6c-84f5-4fc7c4f8d961 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.797386 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de549af4-3655-4f6c-84f5-4fc7c4f8d961 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.837710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-de549af4-3655-4f6c-84f5-4fc7c4f8d961 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/40e3c2aa-db60-4796-a5da-09b4060f6ece" status: 200 len: 194 microversion: 2.1 time: 0.053922 Aug 01 14:14:51.838824 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 362/707] 10.222.0.45 () {58 vars in 1413 bytes} [Mon Aug 1 14:14:51 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/40e3c2aa-db60-4796-a5da-09b4060f6ece => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:51.857800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f2c425fe-3c85-4cc6-b0e8-d00b10214eb7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:51.858293 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f2c425fe-3c85-4cc6-b0e8-d00b10214eb7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:51.865727 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f2c425fe-3c85-4cc6-b0e8-d00b10214eb7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.866169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f2c425fe-3c85-4cc6-b0e8-d00b10214eb7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.866978 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f2c425fe-3c85-4cc6-b0e8-d00b10214eb7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:51.867403 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f2c425fe-3c85-4cc6-b0e8-d00b10214eb7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:51.996240 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-f2c425fe-3c85-4cc6-b0e8-d00b10214eb7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lazy-loading 'services' on Instance uuid 462a7ad5-816c-49b1-a36b-84dc587c93ca {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:14:52.076330 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f2c425fe-3c85-4cc6-b0e8-d00b10214eb7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "DELETE /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/40e3c2aa-db60-4796-a5da-09b4060f6ece" status: 202 len: 0 microversion: 2.1 time: 0.224314 Aug 01 14:14:52.076944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 346/708] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:14:51 2022] DELETE /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments/40e3c2aa-db60-4796-a5da-09b4060f6ece => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:14:52.284736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:52.285325 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] [instance: 36838f66-2529-4a98-88cd-4a0450c2aba5] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:52.292817 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:52.293272 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:52.294040 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:52.294483 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:52.308699 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] HTTP exception thrown: Instance 36838f66-2529-4a98-88cd-4a0450c2aba5 could not be found. Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Request method failure captured: Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 HTTP/1.1 Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595nBvngFLvXmcxyqRbq0vAZso55lRqZPdXo9mG7MzO7BEgpjGUJXmDJ-Wrlr5gSX2E3O49ldx2NkMHkhpNVEedoqx6r8Ucd5xA2QvZhi4cW0ovwwW2Ary3iU0xyJcDZxg2MxyAC0etakIhVNhyVB6hrmON2qyAVhF4w9-kPyJ8xt6U Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:14:52.310367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e85f3e6c18ae4466a1dc3e6464aa18e6", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e85f3e6c18ae4466a1dc3e6464aa18e6"}]}] Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: e85f3e6c18ae4466a1dc3e6464aa18e6 Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036145908 Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a3e93dfa85244133b1641a431994b47f Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036145908-project Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 36838f66-2529-4a98-88cd-4a0450c2aba5 could not be found. Aug 01 14:14:52.312181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '36838f66-2529-4a98-88cd-4a0450c2aba5'} Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36838f66-2529-4a98-88cd-4a0450c2aba5 could not be found. Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:14:52.313095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36838f66-2529-4a98-88cd-4a0450c2aba5 could not be found. Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36838f66-2529-4a98-88cd-4a0450c2aba5 could not be found. Aug 01 14:14:52.314579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.316140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] Returning 404 to user: Instance 36838f66-2529-4a98-88cd-4a0450c2aba5 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:14:52.316140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2878be67-6e65-449b-a8ac-b7e058c62631 tempest-ServerRescueNegativeTestJSON-1036145908 tempest-ServerRescueNegativeTestJSON-1036145908-project] 10.222.0.45 "GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5" status: 404 len: 111 microversion: 2.1 time: 0.031178 Aug 01 14:14:52.316140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 363/709] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:52 2022] GET /compute/v2.1/servers/36838f66-2529-4a98-88cd-4a0450c2aba5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:14:52.553271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:52.554153 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:52.566466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:52.567699 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:52.569510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:52.570275 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:52.587288 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] HTTP exception thrown: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Request method failure captured: Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 HTTP/1.1 Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi597n5rVzsOyGwg0nDBP13SlzfdQVenXJfrdspuRNAs1-4IfgQR81LS92QquvZgt9VglSMGjnu0mlpEZdBZHeBmFYwQay0a1zB9e0aWWsO2_wf1py2OWmcetwcV-UkmQ6cnH4BjDmMHjorqSL5VaivPV1zKWlJX1T6qyEp1SUQLw4n30 Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:14:52.589080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f0a6c07d69ef4cf4a545f48e7079044d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f0a6c07d69ef4cf4a545f48e7079044d"}]}] Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-TestVolumeBootPattern-736803602 Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 8e30910692b4474092f1585a671e2f41 Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:14:52.591020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '0d7f31f9-adc0-4be6-92b9-0c2c99e14308'} Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:14:52.591944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:14:52.594755 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:14:52.596756 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Returning 404 to user: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:14:52.596756 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-eefdac5d-db13-4c6e-83ab-c8615ec6418d tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 404 len: 111 microversion: 2.1 time: 0.042457 Aug 01 14:14:52.596756 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 347/710] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:52 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:14:52.693908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1275824502", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-923806228", "security_groups": [{"name": "tempest-secgroup-smoke-1476544160"}], "block_device_mapping_v2": [{"uuid": "54489e5d-015e-4551-8060-59610ce62d05", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e95fe17e-40dc-4b82-adc2-9adb31102a43"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:52.820395 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] validate_networks() for [('e95fe17e-40dc-4b82-adc2-9adb31102a43', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:14:53.283809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:14:53.284233 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:14:53.284732 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:14:53.285148 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:14:53.285707 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:14:53.288342 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-e7d27038-5ced-47b1-91a1-04689cc052b1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:53.290567 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-e7d27038-5ced-47b1-91a1-04689cc052b1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:53.297005 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e7d27038-5ced-47b1-91a1-04689cc052b1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.297200 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.297444 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e7d27038-5ced-47b1-91a1-04689cc052b1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.297702 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.298202 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e7d27038-5ced-47b1-91a1-04689cc052b1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.298626 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e7d27038-5ced-47b1-91a1-04689cc052b1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.298751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.299585 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.317837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Getting quotas for project f0a6c07d69ef4cf4a545f48e7079044d. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:14:53.322108 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Getting quotas for user 8e30910692b4474092f1585a671e2f41 and project f0a6c07d69ef4cf4a545f48e7079044d. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:14:53.330056 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-e7d27038-5ced-47b1-91a1-04689cc052b1 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046003 Aug 01 14:14:53.330542 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 348/711] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:53 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:14:53.389516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:14:53.392468 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54489e5d-015e-4551-8060-59610ce62d05',volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:14:53.457080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4a5ae0c7-9ef8-4fb5-8aff-03cf5f43782d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:53.460362 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4a5ae0c7-9ef8-4fb5-8aff-03cf5f43782d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:53.467090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4a5ae0c7-9ef8-4fb5-8aff-03cf5f43782d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.467702 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4a5ae0c7-9ef8-4fb5-8aff-03cf5f43782d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.468336 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4a5ae0c7-9ef8-4fb5-8aff-03cf5f43782d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.468775 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4a5ae0c7-9ef8-4fb5-8aff-03cf5f43782d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.514622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4a5ae0c7-9ef8-4fb5-8aff-03cf5f43782d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063498 Aug 01 14:14:53.516117 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 349/712] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:14:53 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 14:14:53.602747 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-10cc54d2-dbf9-4f9c-8714-8ef15cb7693a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.912994 Aug 01 14:14:53.603561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 364/713] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:14:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:14:53.607128 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d87ecd78-5c03-4482-82c3-a6ea432be990 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:53.607859 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d87ecd78-5c03-4482-82c3-a6ea432be990 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:53.616105 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d87ecd78-5c03-4482-82c3-a6ea432be990 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.616876 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d87ecd78-5c03-4482-82c3-a6ea432be990 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.618000 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d87ecd78-5c03-4482-82c3-a6ea432be990 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.618704 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d87ecd78-5c03-4482-82c3-a6ea432be990 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.620084 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a6049390-0fed-452f-af14-deffeb4e02f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:53.620741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a6049390-0fed-452f-af14-deffeb4e02f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:53.664039 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d87ecd78-5c03-4482-82c3-a6ea432be990 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:14:53.721048 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a6049390-0fed-452f-af14-deffeb4e02f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:53.733626 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a6049390-0fed-452f-af14-deffeb4e02f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1094 microversion: 2.1 time: 0.117926 Aug 01 14:14:53.734224 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 365/714] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:53 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:14:53.803466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d87ecd78-5c03-4482-82c3-a6ea432be990 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "DELETE /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 204 len: 0 microversion: 2.1 time: 0.202698 Aug 01 14:14:53.807561 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 350/715] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:14:53 2022] DELETE /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:14:53.817299 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d037f832-c554-462a-9fdc-fff57e12fa5d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:53.818226 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d037f832-c554-462a-9fdc-fff57e12fa5d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:53.828077 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d037f832-c554-462a-9fdc-fff57e12fa5d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.828930 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d037f832-c554-462a-9fdc-fff57e12fa5d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.829938 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d037f832-c554-462a-9fdc-fff57e12fa5d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.830414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d037f832-c554-462a-9fdc-fff57e12fa5d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:54.029592 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d037f832-c554-462a-9fdc-fff57e12fa5d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:54.038955 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d037f832-c554-462a-9fdc-fff57e12fa5d tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1673 microversion: 2.1 time: 0.228599 Aug 01 14:14:54.051516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 366/716] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:53 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1673 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:14:54.756941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-e79ad863-eb89-4e14-8796-cc65d12897e3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:54.758523 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-e79ad863-eb89-4e14-8796-cc65d12897e3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:54.765794 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e79ad863-eb89-4e14-8796-cc65d12897e3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:54.766539 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e79ad863-eb89-4e14-8796-cc65d12897e3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:54.767315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e79ad863-eb89-4e14-8796-cc65d12897e3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:54.767732 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e79ad863-eb89-4e14-8796-cc65d12897e3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:54.841702 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-e79ad863-eb89-4e14-8796-cc65d12897e3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:54.851533 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-e79ad863-eb89-4e14-8796-cc65d12897e3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1144 microversion: 2.1 time: 0.099464 Aug 01 14:14:54.852783 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 351/717] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:54 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:55.060613 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0c661fec-a5b2-452a-9b8e-eff28f74ed16 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:55.061234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0c661fec-a5b2-452a-9b8e-eff28f74ed16 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:55.069011 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c661fec-a5b2-452a-9b8e-eff28f74ed16 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:55.069457 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c661fec-a5b2-452a-9b8e-eff28f74ed16 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:55.070486 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c661fec-a5b2-452a-9b8e-eff28f74ed16 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:55.070924 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c661fec-a5b2-452a-9b8e-eff28f74ed16 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:55.223331 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0c661fec-a5b2-452a-9b8e-eff28f74ed16 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:55.233119 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0c661fec-a5b2-452a-9b8e-eff28f74ed16 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1673 microversion: 2.1 time: 0.176773 Aug 01 14:14:55.233706 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 367/718] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:55 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:55.876356 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6e7dc4cd-fb48-4803-893f-3c5b2fffd299 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:55.877439 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6e7dc4cd-fb48-4803-893f-3c5b2fffd299 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:55.886864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e7dc4cd-fb48-4803-893f-3c5b2fffd299 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:55.887905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e7dc4cd-fb48-4803-893f-3c5b2fffd299 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:55.888954 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e7dc4cd-fb48-4803-893f-3c5b2fffd299 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:55.889573 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e7dc4cd-fb48-4803-893f-3c5b2fffd299 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:56.075537 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6e7dc4cd-fb48-4803-893f-3c5b2fffd299 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:56.084123 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6e7dc4cd-fb48-4803-893f-3c5b2fffd299 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1192 microversion: 2.1 time: 0.212441 Aug 01 14:14:56.098700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 352/719] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:55 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1192 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:56.256841 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ff49f7d4-873f-463b-a2f5-d600e6b30ac7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:56.258908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ff49f7d4-873f-463b-a2f5-d600e6b30ac7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:56.273852 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff49f7d4-873f-463b-a2f5-d600e6b30ac7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:56.276716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff49f7d4-873f-463b-a2f5-d600e6b30ac7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:56.283094 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff49f7d4-873f-463b-a2f5-d600e6b30ac7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:56.283791 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff49f7d4-873f-463b-a2f5-d600e6b30ac7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:56.511647 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9032e83c-7906-4545-a2d9-e1aad966d01f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:56.514150 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-9032e83c-7906-4545-a2d9-e1aad966d01f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:56.523747 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9032e83c-7906-4545-a2d9-e1aad966d01f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:56.524422 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9032e83c-7906-4545-a2d9-e1aad966d01f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:56.526308 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9032e83c-7906-4545-a2d9-e1aad966d01f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:56.526954 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9032e83c-7906-4545-a2d9-e1aad966d01f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:56.566849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-9032e83c-7906-4545-a2d9-e1aad966d01f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lazy-loading 'flavor' on Instance uuid 38da3c04-7cad-47ab-b253-e133bdeb480c {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:14:56.649027 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:56.711242 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9032e83c-7906-4545-a2d9-e1aad966d01f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "POST /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c/action" status: 202 len: 0 microversion: 2.1 time: 0.201891 Aug 01 14:14:56.717578 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 353/720] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:14:56 2022] POST /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:14:56.728159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-12e390e3-9f0a-45dc-b359-5301a74e3a6c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:56.729727 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-12e390e3-9f0a-45dc-b359-5301a74e3a6c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:56.741094 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-12e390e3-9f0a-45dc-b359-5301a74e3a6c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:56.741457 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-12e390e3-9f0a-45dc-b359-5301a74e3a6c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:56.742231 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-12e390e3-9f0a-45dc-b359-5301a74e3a6c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:56.742913 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-12e390e3-9f0a-45dc-b359-5301a74e3a6c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:56.843129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ff49f7d4-873f-463b-a2f5-d600e6b30ac7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:56.854684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ff49f7d4-873f-463b-a2f5-d600e6b30ac7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1673 microversion: 2.1 time: 0.602749 Aug 01 14:14:56.856750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 368/721] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:56 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1673 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:57.108387 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a3244625-ea99-4492-a986-aba84bdf33ab tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:57.110527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a3244625-ea99-4492-a986-aba84bdf33ab tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:57.113354 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:57.120876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3244625-ea99-4492-a986-aba84bdf33ab tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:57.121319 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3244625-ea99-4492-a986-aba84bdf33ab tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:57.122422 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3244625-ea99-4492-a986-aba84bdf33ab tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:57.122603 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3244625-ea99-4492-a986-aba84bdf33ab tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:57.260981 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a3244625-ea99-4492-a986-aba84bdf33ab tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:57.269823 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a3244625-ea99-4492-a986-aba84bdf33ab tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1198 microversion: 2.1 time: 0.167058 Aug 01 14:14:57.270403 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 369/722] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:57 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1198 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:57.341607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-12e390e3-9f0a-45dc-b359-5301a74e3a6c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:57.349813 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-12e390e3-9f0a-45dc-b359-5301a74e3a6c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.629922 Aug 01 14:14:57.350405 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 354/723] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:56 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:57.891527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fea51e1f-726e-460b-9950-8a556662125f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:57.892619 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fea51e1f-726e-460b-9950-8a556662125f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:57.910265 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fea51e1f-726e-460b-9950-8a556662125f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:57.911239 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fea51e1f-726e-460b-9950-8a556662125f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:57.913022 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fea51e1f-726e-460b-9950-8a556662125f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:57.914386 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fea51e1f-726e-460b-9950-8a556662125f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:58.033788 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fea51e1f-726e-460b-9950-8a556662125f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:58.042474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fea51e1f-726e-460b-9950-8a556662125f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1606 microversion: 2.1 time: 0.156028 Aug 01 14:14:58.043444 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 370/724] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:57 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1606 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:58.293459 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0c1091f4-de5f-4f6a-be96-147fc63fdbd3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:58.294207 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0c1091f4-de5f-4f6a-be96-147fc63fdbd3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:58.308284 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0c1091f4-de5f-4f6a-be96-147fc63fdbd3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:58.309054 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0c1091f4-de5f-4f6a-be96-147fc63fdbd3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:58.309552 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0c1091f4-de5f-4f6a-be96-147fc63fdbd3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:58.309982 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0c1091f4-de5f-4f6a-be96-147fc63fdbd3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:58.376427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-52cefab0-1b69-4bea-a081-8c438e25ce90 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:58.377185 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-52cefab0-1b69-4bea-a081-8c438e25ce90 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:58.388180 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-52cefab0-1b69-4bea-a081-8c438e25ce90 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:58.388664 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-52cefab0-1b69-4bea-a081-8c438e25ce90 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:58.389516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-52cefab0-1b69-4bea-a081-8c438e25ce90 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:58.389950 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-52cefab0-1b69-4bea-a081-8c438e25ce90 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:58.734719 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0c1091f4-de5f-4f6a-be96-147fc63fdbd3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:58.740004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-52cefab0-1b69-4bea-a081-8c438e25ce90 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:58.747857 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0c1091f4-de5f-4f6a-be96-147fc63fdbd3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.459326 Aug 01 14:14:58.749603 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-52cefab0-1b69-4bea-a081-8c438e25ce90 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.377713 Aug 01 14:14:58.750752 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 355/725] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:58 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:58.750899 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 371/726] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:58 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:58.755748 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-e224f9f7-8ddc-4b6a-a03b-a88ad9a9bd5c req-fef9398c-a891-4244-a9ff-d8803f5bb956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462a7ad5-816c-49b1-a36b-84dc587c93ca", "name": "network-vif-deleted", "tag": "41238094-cf08-4cf7-b716-88a929b830bb"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:58.776340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e224f9f7-8ddc-4b6a-a03b-a88ad9a9bd5c req-fef9398c-a891-4244-a9ff-d8803f5bb956 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:58.777046 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e224f9f7-8ddc-4b6a-a03b-a88ad9a9bd5c req-fef9398c-a891-4244-a9ff-d8803f5bb956 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:58.792629 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-e224f9f7-8ddc-4b6a-a03b-a88ad9a9bd5c req-fef9398c-a891-4244-a9ff-d8803f5bb956 service nova] Creating event network-vif-deleted:41238094-cf08-4cf7-b716-88a929b830bb for instance 462a7ad5-816c-49b1-a36b-84dc587c93ca on hv-cinder-84517 Aug 01 14:14:58.798643 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-e224f9f7-8ddc-4b6a-a03b-a88ad9a9bd5c req-fef9398c-a891-4244-a9ff-d8803f5bb956 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046311 Aug 01 14:14:58.799398 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 372/727] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:59.069905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:59.072208 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:59.084057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:59.085444 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:59.086920 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:59.088056 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:59.156127 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:59.157297 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:59.157945 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lazy-loading 'fault' on Instance uuid 462a7ad5-816c-49b1-a36b-84dc587c93ca {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:14:59.231945 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f35e960544403ea30ba36d878a86cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1081ae5fd3e9443c80626517ae9c7d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:59.240184 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0918084a-3bb7-4778-b923-9be24dc9746f tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 200 len: 1327 microversion: 2.1 time: 0.177619 Aug 01 14:14:59.240901 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 356/728] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:59 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 1327 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:59.777747 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5f3c63e0-0729-4693-9a43-3ef3cd30111b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:59.779173 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5f3c63e0-0729-4693-9a43-3ef3cd30111b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:59.783073 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-af77d407-cae6-4d84-91a8-4f7f9ce7c19e tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:59.783694 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-af77d407-cae6-4d84-91a8-4f7f9ce7c19e tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:59.786737 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:59.790137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f3c63e0-0729-4693-9a43-3ef3cd30111b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:59.790594 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f3c63e0-0729-4693-9a43-3ef3cd30111b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:59.795823 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f3c63e0-0729-4693-9a43-3ef3cd30111b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:59.796306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f3c63e0-0729-4693-9a43-3ef3cd30111b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:59.812482 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-af77d407-cae6-4d84-91a8-4f7f9ce7c19e tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:59.813152 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-af77d407-cae6-4d84-91a8-4f7f9ce7c19e tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:59.813935 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-af77d407-cae6-4d84-91a8-4f7f9ce7c19e tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:59.814375 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-af77d407-cae6-4d84-91a8-4f7f9ce7c19e tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:00.187859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5f3c63e0-0729-4693-9a43-3ef3cd30111b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:00.204254 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5f3c63e0-0729-4693-9a43-3ef3cd30111b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.436098 Aug 01 14:15:00.218271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-af77d407-cae6-4d84-91a8-4f7f9ce7c19e tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:00.224238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 373/729] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:59 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:00.248759 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-af77d407-cae6-4d84-91a8-4f7f9ce7c19e tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.464112 Aug 01 14:15:00.250808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 357/730] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:59 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:00.265301 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:00.266045 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:00.277401 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:00.278356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:00.279365 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:00.281028 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:00.310028 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] HTTP exception thrown: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Request method failure captured: Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca HTTP/1.1 Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595aE0N9koR2Ter1AhuZogg1ECqfLPydJ7SJ0uq8BUPhXsAvnVMfZrK9CmkmC0mIepUkUyQsoqAFfo198EyedsYToTaER2Z4Rt5jfAd-IemVRy2qhroPtXKVQWx5UlhSz9Ps_QOz9D6x4h1J-tEqPf6JD7egENjQ3rh0cd7MOT18jYQ Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:15:00.312851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1081ae5fd3e9443c80626517ae9c7d77", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1081ae5fd3e9443c80626517ae9c7d77"}]}] Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 87f35e960544403ea30ba36d878a86cb Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:00.314478 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '462a7ad5-816c-49b1-a36b-84dc587c93ca'} Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:15:00.315345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:00.316777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:00.319289 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Returning 404 to user: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:15:00.321487 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1f658deb-bb97-446d-849b-eff2c0d00577 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 404 len: 111 microversion: 2.1 time: 0.062762 Aug 01 14:15:00.323238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 374/731] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:00 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:15:00.331656 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b89f7578-a9c9-45e5-a41d-701a6cd5e5b7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '.version_select at 0x7fc57952da60>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:00.364603 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b89f7578-a9c9-45e5-a41d-701a6cd5e5b7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-659956227" status: 202 len: 0 microversion: 2.1 time: 0.034985 Aug 01 14:15:00.366029 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 358/732] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 14:15:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-659956227 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:15:01.137140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-ab3ff159-259a-44d2-a076-668a4f2c4af4 req-9fc40129-61c8-4e5e-8989-be1fb5cf8846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1842e4-dc37-4e0d-b172-23f29125f8d0", "tag": "b550f9ea-8012-4b81-8b79-2ea6bb8e8012"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:01.157272 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ab3ff159-259a-44d2-a076-668a4f2c4af4 req-9fc40129-61c8-4e5e-8989-be1fb5cf8846 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:01.158370 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ab3ff159-259a-44d2-a076-668a4f2c4af4 req-9fc40129-61c8-4e5e-8989-be1fb5cf8846 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:01.179069 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-ab3ff159-259a-44d2-a076-668a4f2c4af4 req-9fc40129-61c8-4e5e-8989-be1fb5cf8846 service nova] Creating event network-changed:b550f9ea-8012-4b81-8b79-2ea6bb8e8012 for instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 on hv-cinder-84517 Aug 01 14:15:01.184535 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-ab3ff159-259a-44d2-a076-668a4f2c4af4 req-9fc40129-61c8-4e5e-8989-be1fb5cf8846 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054675 Aug 01 14:15:01.185809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 375/733] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:01.240128 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-be349821-a0ad-4729-ba27-97824170c776 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:01.242319 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-be349821-a0ad-4729-ba27-97824170c776 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:01.261604 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-be349821-a0ad-4729-ba27-97824170c776 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:01.262458 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-be349821-a0ad-4729-ba27-97824170c776 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:01.263435 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-be349821-a0ad-4729-ba27-97824170c776 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:01.264221 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-be349821-a0ad-4729-ba27-97824170c776 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:01.283477 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-26e71e1c-2420-4221-a815-17d2e147177f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:01.287812 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-26e71e1c-2420-4221-a815-17d2e147177f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:01.302395 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-26e71e1c-2420-4221-a815-17d2e147177f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:01.303658 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-26e71e1c-2420-4221-a815-17d2e147177f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:01.304789 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-26e71e1c-2420-4221-a815-17d2e147177f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:01.310236 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-26e71e1c-2420-4221-a815-17d2e147177f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:01.695405 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-be349821-a0ad-4729-ba27-97824170c776 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:01.709995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-26e71e1c-2420-4221-a815-17d2e147177f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:01.730049 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-be349821-a0ad-4729-ba27-97824170c776 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.501220 Aug 01 14:15:01.748365 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 359/734] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:01 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:01.748758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-26e71e1c-2420-4221-a815-17d2e147177f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.468288 Aug 01 14:15:01.748758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 376/735] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:01 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:02.765836 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1e26521e-ed00-4222-8959-d8809e728abd tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:02.767202 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-60513f63-3c39-47d9-aba3-ced240a08601 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:02.767672 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1e26521e-ed00-4222-8959-d8809e728abd tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:02.768213 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-60513f63-3c39-47d9-aba3-ced240a08601 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:02.784860 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60513f63-3c39-47d9-aba3-ced240a08601 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:02.785469 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60513f63-3c39-47d9-aba3-ced240a08601 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:02.787129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60513f63-3c39-47d9-aba3-ced240a08601 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:02.788806 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60513f63-3c39-47d9-aba3-ced240a08601 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:02.790740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1e26521e-ed00-4222-8959-d8809e728abd tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:02.791586 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1e26521e-ed00-4222-8959-d8809e728abd tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:02.793033 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1e26521e-ed00-4222-8959-d8809e728abd tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:02.797600 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1e26521e-ed00-4222-8959-d8809e728abd tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:03.057699 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1e26521e-ed00-4222-8959-d8809e728abd tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:03.063379 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-60513f63-3c39-47d9-aba3-ced240a08601 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:03.072384 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:03.073962 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1e26521e-ed00-4222-8959-d8809e728abd tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.315044 Aug 01 14:15:03.076020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 360/736] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:02 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:03.078579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-60513f63-3c39-47d9-aba3-ced240a08601 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.318212 Aug 01 14:15:03.084536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 377/737] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:02 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:04.101495 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6ad6be32-0148-4cc5-be62-467fce8aef36 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:04.104389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6ad6be32-0148-4cc5-be62-467fce8aef36 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:04.105583 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f343b53c-a08e-4f70-918d-1cba5aa7125b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:04.106548 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f343b53c-a08e-4f70-918d-1cba5aa7125b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:04.114023 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:04.115657 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6ad6be32-0148-4cc5-be62-467fce8aef36 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.116454 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=8 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:04.117282 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6ad6be32-0148-4cc5-be62-467fce8aef36 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.118774 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6ad6be32-0148-4cc5-be62-467fce8aef36 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.119849 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f343b53c-a08e-4f70-918d-1cba5aa7125b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.120171 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6ad6be32-0148-4cc5-be62-467fce8aef36 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.120453 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f343b53c-a08e-4f70-918d-1cba5aa7125b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.121343 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f343b53c-a08e-4f70-918d-1cba5aa7125b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.121830 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f343b53c-a08e-4f70-918d-1cba5aa7125b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.403985 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f343b53c-a08e-4f70-918d-1cba5aa7125b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:04.418336 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f343b53c-a08e-4f70-918d-1cba5aa7125b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.318920 Aug 01 14:15:04.436669 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 378/738] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:04 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:04.442809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:04.443629 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:04.451093 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.451484 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.452387 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.452693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.477077 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] HTTP exception thrown: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Request method failure captured: Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca HTTP/1.1 Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595aE0N9koR2Ter1AhuZogg1ECqfLPydJ7SJ0uq8BUPhXsAvnVMfZrK9CmkmC0mIepUkUyQsoqAFfo198EyedsYToTaER2Z4Rt5jfAd-IemVRy2qhroPtXKVQWx5UlhSz9Ps_QOz9D6x4h1J-tEqPf6JD7egENjQ3rh0cd7MOT18jYQ Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:15:04.479251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1081ae5fd3e9443c80626517ae9c7d77", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1081ae5fd3e9443c80626517ae9c7d77"}]}] Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 87f35e960544403ea30ba36d878a86cb Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.480665 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '462a7ad5-816c-49b1-a36b-84dc587c93ca'} Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:15:04.481434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.482917 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.485003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Returning 404 to user: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:15:04.486218 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4989b846-fa9d-4521-86fd-ac26f82763fd tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "DELETE /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 404 len: 111 microversion: 2.1 time: 0.048117 Aug 01 14:15:04.487744 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 379/739] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:15:04 2022] DELETE /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:15:04.505716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:04.506809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 462a7ad5-816c-49b1-a36b-84dc587c93ca] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:04.513596 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.514037 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.514810 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.515241 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.534001 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6ad6be32-0148-4cc5-be62-467fce8aef36 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:04.545900 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] HTTP exception thrown: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Request method failure captured: Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca HTTP/1.1 Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi595aE0N9koR2Ter1AhuZogg1ECqfLPydJ7SJ0uq8BUPhXsAvnVMfZrK9CmkmC0mIepUkUyQsoqAFfo198EyedsYToTaER2Z4Rt5jfAd-IemVRy2qhroPtXKVQWx5UlhSz9Ps_QOz9D6x4h1J-tEqPf6JD7egENjQ3rh0cd7MOT18jYQ Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:15:04.547473 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1081ae5fd3e9443c80626517ae9c7d77", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1081ae5fd3e9443c80626517ae9c7d77"}]}] Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 87f35e960544403ea30ba36d878a86cb Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.548973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '462a7ad5-816c-49b1-a36b-84dc587c93ca'} Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:15:04.549956 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. Aug 01 14:15:04.551506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:15:04.553905 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Returning 404 to user: Instance 462a7ad5-816c-49b1-a36b-84dc587c93ca could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:15:04.554775 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-48a2f3fa-5861-4445-aafb-e8b44b4c6921 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca" status: 404 len: 111 microversion: 2.1 time: 0.054763 Aug 01 14:15:04.555352 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 380/740] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:04 2022] GET /compute/v2.1/servers/462a7ad5-816c-49b1-a36b-84dc587c93ca => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:15:04.556457 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6ad6be32-0148-4cc5-be62-467fce8aef36 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.447960 Aug 01 14:15:04.557778 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 361/741] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:04 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:05.444989 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d92eff49-230d-4b16-bdd6-c1acc24c6f81 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:05.446327 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d92eff49-230d-4b16-bdd6-c1acc24c6f81 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:05.455373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d92eff49-230d-4b16-bdd6-c1acc24c6f81 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.455995 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d92eff49-230d-4b16-bdd6-c1acc24c6f81 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.457006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d92eff49-230d-4b16-bdd6-c1acc24c6f81 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.457586 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d92eff49-230d-4b16-bdd6-c1acc24c6f81 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.591008 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a806a87b-0160-4538-a55e-5ffbc6f5ef94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:05.594099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a806a87b-0160-4538-a55e-5ffbc6f5ef94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:05.602469 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a806a87b-0160-4538-a55e-5ffbc6f5ef94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.603083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a806a87b-0160-4538-a55e-5ffbc6f5ef94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.603963 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a806a87b-0160-4538-a55e-5ffbc6f5ef94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.604508 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a806a87b-0160-4538-a55e-5ffbc6f5ef94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.651469 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d92eff49-230d-4b16-bdd6-c1acc24c6f81 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:05.668949 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d92eff49-230d-4b16-bdd6-c1acc24c6f81 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.229470 Aug 01 14:15:05.669543 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 381/742] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:05 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:05.809576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a806a87b-0160-4538-a55e-5ffbc6f5ef94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:05.824642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a806a87b-0160-4538-a55e-5ffbc6f5ef94 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.248960 Aug 01 14:15:05.825690 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 362/743] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:05 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:05.840425 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:05.841527 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:05.851160 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.851645 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.852705 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.853291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.872107 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] HTTP exception thrown: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Request method failure captured: Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: DELETE /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 HTTP/1.1 Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi595aE0N9koR2Ter1AhuZogg1ECqfLPydJ7SJ0uq8BUPhXsAvnVMfZrK9CmkmC0mIepUkUyQsoqAFfo198EyedsYToTaER2Z4Rt5jfAd-IemVRy2qhroPtXKVQWx5UlhSz9Ps_QOz9D6x4h1J-tEqPf6JD7egENjQ3rh0cd7MOT18jYQ Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:15:05.874080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1081ae5fd3e9443c80626517ae9c7d77", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1081ae5fd3e9443c80626517ae9c7d77"}]}] Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 87f35e960544403ea30ba36d878a86cb Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.882668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8'} Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:15:05.884419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.886808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.891358 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Returning 404 to user: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:15:05.891358 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0d4709d9-dd00-4289-885d-4d5c0db11ee7 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 404 len: 111 microversion: 2.1 time: 0.048393 Aug 01 14:15:05.891358 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 363/744] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:15:05 2022] DELETE /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:15:05.891825 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6ecff195-5380-4c35-90e3-ec368d2495e1 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: .version_select at 0x7fc5797034c0>, body: {"keypair": {"name": "tempest-keypair-598913868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ3wwbIrSQlspXwbtLfqwJSf7vmYBT9c54CZZYZ0KQ1eYixUrhvaRXVwC60oouoZ2wWg8qDCMP4mRj7kDCe/gCq+rHXZkPa2FT3FwfU+yTgdiyfCbVlJJNSKvLBMJLsUA=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:05.893460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:05.893460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] [instance: 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:05.893968 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.894543 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.895243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.895850 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.912901 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-6ecff195-5380-4c35-90e3-ec368d2495e1 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for project db87d8b3358945aa88acbdc4246917ae. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:15:05.915394 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] HTTP exception thrown: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Request method failure captured: Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 HTTP/1.1 Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi595aE0N9koR2Ter1AhuZogg1ECqfLPydJ7SJ0uq8BUPhXsAvnVMfZrK9CmkmC0mIepUkUyQsoqAFfo198EyedsYToTaER2Z4Rt5jfAd-IemVRy2qhroPtXKVQWx5UlhSz9Ps_QOz9D6x4h1J-tEqPf6JD7egENjQ3rh0cd7MOT18jYQ Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:15:05.918991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1081ae5fd3e9443c80626517ae9c7d77", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1081ae5fd3e9443c80626517ae9c7d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1081ae5fd3e9443c80626517ae9c7d77"}]}] Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 1081ae5fd3e9443c80626517ae9c7d77 Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080606932 Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 87f35e960544403ea30ba36d878a86cb Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeTestJSON-2080606932-project Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.921701 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8'} Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:15:05.922568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. Aug 01 14:15:05.923991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:15:05.925317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] Returning 404 to user: Instance 2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:15:05.925409 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-6ecff195-5380-4c35-90e3-ec368d2495e1 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for user a9fc33bdca304c33b6a78122a54f492a and project db87d8b3358945aa88acbdc4246917ae. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:15:05.925504 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-07a35192-9e87-423d-86ac-ee1a23bf69b4 tempest-AttachVolumeTestJSON-2080606932 tempest-AttachVolumeTestJSON-2080606932-project] 10.222.0.45 "GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8" status: 404 len: 111 microversion: 2.1 time: 0.040143 Aug 01 14:15:05.928443 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 364/745] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:05 2022] GET /compute/v2.1/servers/2d6b2566-c3f3-4fbc-90fe-1fb8cd6b70d8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:15:05.972579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6ecff195-5380-4c35-90e3-ec368d2495e1 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.288036 Aug 01 14:15:05.973701 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 382/746] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:15:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:06.691316 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-33a62706-d0a1-4689-9059-ae2b836c8519 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:06.692101 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-33a62706-d0a1-4689-9059-ae2b836c8519 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:06.699792 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-33a62706-d0a1-4689-9059-ae2b836c8519 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:06.700648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-33a62706-d0a1-4689-9059-ae2b836c8519 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:06.701618 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-33a62706-d0a1-4689-9059-ae2b836c8519 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:06.702353 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-33a62706-d0a1-4689-9059-ae2b836c8519 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:06.856724 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d4282eb6-eb50-45fb-86d1-bc2988590dc9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:06.858109 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d4282eb6-eb50-45fb-86d1-bc2988590dc9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:06.873625 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4282eb6-eb50-45fb-86d1-bc2988590dc9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:06.874081 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4282eb6-eb50-45fb-86d1-bc2988590dc9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:06.875072 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4282eb6-eb50-45fb-86d1-bc2988590dc9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:06.875703 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4282eb6-eb50-45fb-86d1-bc2988590dc9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:07.024359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-33a62706-d0a1-4689-9059-ae2b836c8519 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:07.037401 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-33a62706-d0a1-4689-9059-ae2b836c8519 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.348989 Aug 01 14:15:07.040493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 365/747] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:06 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:07.171758 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d4282eb6-eb50-45fb-86d1-bc2988590dc9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:07.186215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d4282eb6-eb50-45fb-86d1-bc2988590dc9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.338950 Aug 01 14:15:07.187124 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 383/748] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:06 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:07.968320 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-454053880", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1987c22e-ab83-4108-bc22-29b9909b71a1"}], "security_groups": [{"name": "tempest-securitygroup--888768002"}], "key_name": "tempest-keypair-598913868", "user_data": "}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:08.069908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2c9d876d-b3b2-4490-8b02-e4cd24ed430a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:08.070608 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2c9d876d-b3b2-4490-8b02-e4cd24ed430a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:08.081862 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2c9d876d-b3b2-4490-8b02-e4cd24ed430a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:08.082306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2c9d876d-b3b2-4490-8b02-e4cd24ed430a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:08.083133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2c9d876d-b3b2-4490-8b02-e4cd24ed430a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:08.088751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2c9d876d-b3b2-4490-8b02-e4cd24ed430a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:08.365083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] validate_networks() for [('1987c22e-ab83-4108-bc22-29b9909b71a1', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:15:08.593944 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2c9d876d-b3b2-4490-8b02-e4cd24ed430a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:08.605052 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2c9d876d-b3b2-4490-8b02-e4cd24ed430a tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.542411 Aug 01 14:15:08.605924 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 384/749] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:08 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:08.611352 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b5492cfc-5d24-40e8-8998-bf441bce4d05 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:08.612538 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b5492cfc-5d24-40e8-8998-bf441bce4d05 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:08.619420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b5492cfc-5d24-40e8-8998-bf441bce4d05 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:08.619903 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b5492cfc-5d24-40e8-8998-bf441bce4d05 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:08.620921 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b5492cfc-5d24-40e8-8998-bf441bce4d05 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:08.621176 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b5492cfc-5d24-40e8-8998-bf441bce4d05 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:09.140767 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b5492cfc-5d24-40e8-8998-bf441bce4d05 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:09.164514 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b5492cfc-5d24-40e8-8998-bf441bce4d05 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.557261 Aug 01 14:15:09.165796 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 385/750] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:08 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:09.410711 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:15:09.412390 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:15:09.413925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:15:09.415076 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:15:09.416782 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:15:09.434112 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:09.435472 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:09.436764 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:09.437466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:09.461867 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for project db87d8b3358945aa88acbdc4246917ae. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:15:09.468609 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for user a9fc33bdca304c33b6a78122a54f492a and project db87d8b3358945aa88acbdc4246917ae. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:15:09.489810 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:15:09.492477 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:15:09.575925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-39e2e87f-e9d3-4f52-8803-d28117884ca8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.612813 Aug 01 14:15:09.583324 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 366/751] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:15:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:15:09.589877 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bab286bb-d4b7-40df-a45e-94b597e6123b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:09.590514 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bab286bb-d4b7-40df-a45e-94b597e6123b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:09.627268 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-fb5c0bcf-5a5d-4801-9142-f50073854267 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:09.628489 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-fb5c0bcf-5a5d-4801-9142-f50073854267 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:09.642450 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb5c0bcf-5a5d-4801-9142-f50073854267 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:09.646360 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb5c0bcf-5a5d-4801-9142-f50073854267 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:09.647536 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb5c0bcf-5a5d-4801-9142-f50073854267 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:09.652560 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fb5c0bcf-5a5d-4801-9142-f50073854267 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:09.718733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bab286bb-d4b7-40df-a45e-94b597e6123b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:09.727311 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bab286bb-d4b7-40df-a45e-94b597e6123b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1240 microversion: 2.1 time: 0.142745 Aug 01 14:15:09.731503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 386/752] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:09 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1240 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:09.940763 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-fb5c0bcf-5a5d-4801-9142-f50073854267 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:09.959169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-fb5c0bcf-5a5d-4801-9142-f50073854267 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.335688 Aug 01 14:15:09.960308 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 367/753] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:09 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:10.186389 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-360e8463-afe6-4a8f-9d00-e1d5e1a53eb1 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:10.187920 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-360e8463-afe6-4a8f-9d00-e1d5e1a53eb1 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:10.201564 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-360e8463-afe6-4a8f-9d00-e1d5e1a53eb1 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:10.202375 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-360e8463-afe6-4a8f-9d00-e1d5e1a53eb1 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:10.204689 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-360e8463-afe6-4a8f-9d00-e1d5e1a53eb1 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:10.206146 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-360e8463-afe6-4a8f-9d00-e1d5e1a53eb1 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:10.453969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-360e8463-afe6-4a8f-9d00-e1d5e1a53eb1 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:10.463696 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-360e8463-afe6-4a8f-9d00-e1d5e1a53eb1 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.281024 Aug 01 14:15:10.465215 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 387/754] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:10 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:10.752183 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1dd7fbba-c016-43d1-aa91-3b278bf3fa02 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:10.754081 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1dd7fbba-c016-43d1-aa91-3b278bf3fa02 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:10.764696 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1dd7fbba-c016-43d1-aa91-3b278bf3fa02 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:10.766605 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1dd7fbba-c016-43d1-aa91-3b278bf3fa02 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:10.767437 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1dd7fbba-c016-43d1-aa91-3b278bf3fa02 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:10.767869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1dd7fbba-c016-43d1-aa91-3b278bf3fa02 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:10.857857 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1dd7fbba-c016-43d1-aa91-3b278bf3fa02 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:10.887327 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1dd7fbba-c016-43d1-aa91-3b278bf3fa02 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1292 microversion: 2.1 time: 0.142658 Aug 01 14:15:10.887997 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 368/755] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:10 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1292 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:10.995948 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-48dca4cf-cfc4-4444-8bc9-e4664ef60812 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:10.996560 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-48dca4cf-cfc4-4444-8bc9-e4664ef60812 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:11.007010 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-b5fa8f59-97a1-4084-b100-23276cdf4c47 req-4b58ead0-c44b-409f-9b4e-9dc71f44d2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1842e4-dc37-4e0d-b172-23f29125f8d0", "name": "network-vif-plugged", "status": "completed", "tag": "b550f9ea-8012-4b81-8b79-2ea6bb8e8012"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:11.023376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48dca4cf-cfc4-4444-8bc9-e4664ef60812 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.025865 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-b5fa8f59-97a1-4084-b100-23276cdf4c47 req-4b58ead0-c44b-409f-9b4e-9dc71f44d2b9 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.026812 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-b5fa8f59-97a1-4084-b100-23276cdf4c47 req-4b58ead0-c44b-409f-9b4e-9dc71f44d2b9 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.028978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48dca4cf-cfc4-4444-8bc9-e4664ef60812 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.029814 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48dca4cf-cfc4-4444-8bc9-e4664ef60812 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.030238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48dca4cf-cfc4-4444-8bc9-e4664ef60812 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.045658 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-b5fa8f59-97a1-4084-b100-23276cdf4c47 req-4b58ead0-c44b-409f-9b4e-9dc71f44d2b9 service nova] Creating event network-vif-plugged:b550f9ea-8012-4b81-8b79-2ea6bb8e8012 for instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 on hv-cinder-84517 Aug 01 14:15:11.054375 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-b5fa8f59-97a1-4084-b100-23276cdf4c47 req-4b58ead0-c44b-409f-9b4e-9dc71f44d2b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051645 Aug 01 14:15:11.055277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 369/756] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:11.085795 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-e4acc6af-5003-410a-b2df-7f7bbd3c73df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:11.088812 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-e4acc6af-5003-410a-b2df-7f7bbd3c73df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:11.099668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e4acc6af-5003-410a-b2df-7f7bbd3c73df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.117017 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e4acc6af-5003-410a-b2df-7f7bbd3c73df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.118081 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e4acc6af-5003-410a-b2df-7f7bbd3c73df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.125059 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e4acc6af-5003-410a-b2df-7f7bbd3c73df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.160728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-e4acc6af-5003-410a-b2df-7f7bbd3c73df tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/ips" status: 200 len: 150 microversion: 2.20 time: 0.081111 Aug 01 14:15:11.162019 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 370/757] 10.222.0.45 () {60 vars in 1289 bytes} [Mon Aug 1 14:15:11 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/ips => generated 150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:15:11.328725 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-48dca4cf-cfc4-4444-8bc9-e4664ef60812 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:11.351886 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-48dca4cf-cfc4-4444-8bc9-e4664ef60812 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.367309 Aug 01 14:15:11.353144 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 388/758] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:10 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:11.495860 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3e4ea8b9-3efd-4d07-baa7-63e8317e13f9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:11.496900 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3e4ea8b9-3efd-4d07-baa7-63e8317e13f9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:11.529896 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3e4ea8b9-3efd-4d07-baa7-63e8317e13f9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.530368 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3e4ea8b9-3efd-4d07-baa7-63e8317e13f9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.531595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3e4ea8b9-3efd-4d07-baa7-63e8317e13f9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.531955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3e4ea8b9-3efd-4d07-baa7-63e8317e13f9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.911833 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bac92e93-9cf3-46aa-a55b-57713cd6c0c2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:11.913136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bac92e93-9cf3-46aa-a55b-57713cd6c0c2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:11.922115 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3e4ea8b9-3efd-4d07-baa7-63e8317e13f9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:11.941070 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3e4ea8b9-3efd-4d07-baa7-63e8317e13f9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.451082 Aug 01 14:15:11.961159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 371/759] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:11 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:11.962629 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bac92e93-9cf3-46aa-a55b-57713cd6c0c2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.969062 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bac92e93-9cf3-46aa-a55b-57713cd6c0c2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.969960 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bac92e93-9cf3-46aa-a55b-57713cd6c0c2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.970461 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bac92e93-9cf3-46aa-a55b-57713cd6c0c2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:12.091735 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bac92e93-9cf3-46aa-a55b-57713cd6c0c2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:12.103753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bac92e93-9cf3-46aa-a55b-57713cd6c0c2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1298 microversion: 2.1 time: 0.197133 Aug 01 14:15:12.105165 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 389/760] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:11 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:12.378232 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-481b7470-3084-4dd6-b626-d321a445e78c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:12.379281 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-481b7470-3084-4dd6-b626-d321a445e78c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:12.400184 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-481b7470-3084-4dd6-b626-d321a445e78c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:12.400737 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-481b7470-3084-4dd6-b626-d321a445e78c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:12.402425 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-481b7470-3084-4dd6-b626-d321a445e78c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:12.402880 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-481b7470-3084-4dd6-b626-d321a445e78c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:12.677050 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-481b7470-3084-4dd6-b626-d321a445e78c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:12.687557 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-481b7470-3084-4dd6-b626-d321a445e78c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1508 microversion: 2.1 time: 0.316871 Aug 01 14:15:12.688324 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 372/761] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:12 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:12.728853 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-92febb83-3c3d-49d5-98d4-397a32312049 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:12.731153 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-92febb83-3c3d-49d5-98d4-397a32312049 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:12.752465 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92febb83-3c3d-49d5-98d4-397a32312049 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:12.753612 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92febb83-3c3d-49d5-98d4-397a32312049 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:12.755716 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92febb83-3c3d-49d5-98d4-397a32312049 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:12.756483 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92febb83-3c3d-49d5-98d4-397a32312049 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:12.852628 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-92febb83-3c3d-49d5-98d4-397a32312049 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118111) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:15:12.984729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-92febb83-3c3d-49d5-98d4-397a32312049 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "POST /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c/action" status: 202 len: 0 microversion: 2.1 time: 0.261375 Aug 01 14:15:12.997289 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 390/762] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 14:15:12 2022] POST /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:15:12.998562 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-64b2825f-b8c7-49a5-b8a1-fff3ccf726c4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:12.999591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-64b2825f-b8c7-49a5-b8a1-fff3ccf726c4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:13.004306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ab1f4732-9b9b-4995-acec-d4ef4b4dfdc2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:13.005052 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ab1f4732-9b9b-4995-acec-d4ef4b4dfdc2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:13.014463 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab1f4732-9b9b-4995-acec-d4ef4b4dfdc2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:13.015015 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab1f4732-9b9b-4995-acec-d4ef4b4dfdc2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:13.018118 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab1f4732-9b9b-4995-acec-d4ef4b4dfdc2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:13.018699 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ab1f4732-9b9b-4995-acec-d4ef4b4dfdc2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:13.035004 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-64b2825f-b8c7-49a5-b8a1-fff3ccf726c4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:13.035766 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-64b2825f-b8c7-49a5-b8a1-fff3ccf726c4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:13.037172 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-64b2825f-b8c7-49a5-b8a1-fff3ccf726c4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:13.051100 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-64b2825f-b8c7-49a5-b8a1-fff3ccf726c4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:13.115929 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:13.765712 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ab1f4732-9b9b-4995-acec-d4ef4b4dfdc2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:13.785865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ab1f4732-9b9b-4995-acec-d4ef4b4dfdc2 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1516 microversion: 2.1 time: 0.786749 Aug 01 14:15:13.786511 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 391/763] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:12 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1516 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:13.807396 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-630c046a-6e46-49d6-8113-e3eac3673e2c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:13.808249 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-630c046a-6e46-49d6-8113-e3eac3673e2c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:13.825586 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-630c046a-6e46-49d6-8113-e3eac3673e2c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:13.826316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-630c046a-6e46-49d6-8113-e3eac3673e2c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:13.827406 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-630c046a-6e46-49d6-8113-e3eac3673e2c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:13.828003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-630c046a-6e46-49d6-8113-e3eac3673e2c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:13.963303 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-64b2825f-b8c7-49a5-b8a1-fff3ccf726c4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:13.977495 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-64b2825f-b8c7-49a5-b8a1-fff3ccf726c4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1266 microversion: 2.1 time: 0.993221 Aug 01 14:15:13.978464 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 373/764] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:12 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1266 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:14.120955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ae0315c3-5d0c-452f-8d2c-398559d2d96b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:14.121874 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ae0315c3-5d0c-452f-8d2c-398559d2d96b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:14.141438 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ae0315c3-5d0c-452f-8d2c-398559d2d96b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:14.141882 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ae0315c3-5d0c-452f-8d2c-398559d2d96b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:14.152326 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ae0315c3-5d0c-452f-8d2c-398559d2d96b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:14.152790 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ae0315c3-5d0c-452f-8d2c-398559d2d96b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:14.155336 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-630c046a-6e46-49d6-8113-e3eac3673e2c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:14.177504 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-630c046a-6e46-49d6-8113-e3eac3673e2c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1365 microversion: 2.1 time: 0.374539 Aug 01 14:15:14.178113 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 392/765] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:13 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:14.220822 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-ae0315c3-5d0c-452f-8d2c-398559d2d96b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lazy-loading 'flavor' on Instance uuid a2880642-059e-4718-b9ed-becd8b1dad8c {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:15:14.523407 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ae0315c3-5d0c-452f-8d2c-398559d2d96b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/action" status: 202 len: 0 microversion: 2.20 time: 0.407063 Aug 01 14:15:14.525980 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 374/766] 10.222.0.45 () {62 vars in 1319 bytes} [Mon Aug 1 14:15:14 2022] POST /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:15:14.551848 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:14.556783 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:14.578042 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:14.579230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:14.584770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:14.586329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:14.818334 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c785d47c-60fb-4e5a-94d3-64013d702111 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:14.827453 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c785d47c-60fb-4e5a-94d3-64013d702111 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:14.869214 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c785d47c-60fb-4e5a-94d3-64013d702111 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:14.870063 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c785d47c-60fb-4e5a-94d3-64013d702111 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:14.871482 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c785d47c-60fb-4e5a-94d3-64013d702111 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:14.877930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c785d47c-60fb-4e5a-94d3-64013d702111 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:14.965320 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:15.007466 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:15.023677 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:15.035606 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-895123bf-4c7e-4621-8b84-a71f03e656b9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.498877 Aug 01 14:15:15.048386 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 393/767] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:14 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:15:15.068842 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-06f74f98-9307-4897-8bed-f6433056b918 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:15.068842 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-06f74f98-9307-4897-8bed-f6433056b918 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:15.111355 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06f74f98-9307-4897-8bed-f6433056b918 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.111946 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06f74f98-9307-4897-8bed-f6433056b918 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.116872 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06f74f98-9307-4897-8bed-f6433056b918 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.117889 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06f74f98-9307-4897-8bed-f6433056b918 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.399003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c785d47c-60fb-4e5a-94d3-64013d702111 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:15.411322 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c785d47c-60fb-4e5a-94d3-64013d702111 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1518 microversion: 2.1 time: 0.601170 Aug 01 14:15:15.412905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 375/768] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:14 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1518 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:15.423596 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-553b2ab3-e98f-403b-8089-02020a258489 req-1859a558-0774-494c-bd6e-5c0bcee3aec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38da3c04-7cad-47ab-b253-e133bdeb480c", "name": "network-vif-unplugged", "status": "completed", "tag": "ec79e886-ddb7-4769-af78-cfcf4186343e"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:15.444916 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-553b2ab3-e98f-403b-8089-02020a258489 req-1859a558-0774-494c-bd6e-5c0bcee3aec2 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.446206 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-553b2ab3-e98f-403b-8089-02020a258489 req-1859a558-0774-494c-bd6e-5c0bcee3aec2 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.476419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-553b2ab3-e98f-403b-8089-02020a258489 req-1859a558-0774-494c-bd6e-5c0bcee3aec2 service nova] Creating event network-vif-unplugged:ec79e886-ddb7-4769-af78-cfcf4186343e for instance 38da3c04-7cad-47ab-b253-e133bdeb480c on hv-cinder-84517 Aug 01 14:15:15.485827 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-553b2ab3-e98f-403b-8089-02020a258489 req-1859a558-0774-494c-bd6e-5c0bcee3aec2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070021 Aug 01 14:15:15.487345 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 376/769] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:15.501164 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-29e23dc8-f94d-44a4-ad00-c1a715cc4598 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:15.502564 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-29e23dc8-f94d-44a4-ad00-c1a715cc4598 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:15.503335 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-06f74f98-9307-4897-8bed-f6433056b918 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:15.515299 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-29e23dc8-f94d-44a4-ad00-c1a715cc4598 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.516500 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-29e23dc8-f94d-44a4-ad00-c1a715cc4598 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.518084 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-29e23dc8-f94d-44a4-ad00-c1a715cc4598 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.519473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-29e23dc8-f94d-44a4-ad00-c1a715cc4598 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.523576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-06f74f98-9307-4897-8bed-f6433056b918 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1453 microversion: 2.1 time: 0.481983 Aug 01 14:15:15.527033 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 394/770] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:15 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1453 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:15.550992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-837d97c8-a91e-4a3d-877a-3d93606a1928 req-63f86670-c181-4235-bebb-59b4db00dd3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730a6765-52cd-4528-9957-3165769c0820", "tag": "84a9217a-963b-4cc2-9c3d-d50aea2772d1"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:15.565599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-837d97c8-a91e-4a3d-877a-3d93606a1928 req-63f86670-c181-4235-bebb-59b4db00dd3b service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.566522 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-837d97c8-a91e-4a3d-877a-3d93606a1928 req-63f86670-c181-4235-bebb-59b4db00dd3b service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.586034 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-837d97c8-a91e-4a3d-877a-3d93606a1928 req-63f86670-c181-4235-bebb-59b4db00dd3b service nova] Creating event network-changed:84a9217a-963b-4cc2-9c3d-d50aea2772d1 for instance 730a6765-52cd-4528-9957-3165769c0820 on hv-cinder-84517 Aug 01 14:15:15.593041 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-837d97c8-a91e-4a3d-877a-3d93606a1928 req-63f86670-c181-4235-bebb-59b4db00dd3b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060612 Aug 01 14:15:15.594273 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 395/771] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:15.602168 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-09d47331-f1a1-4241-b508-78286b46c638 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:15.603402 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-09d47331-f1a1-4241-b508-78286b46c638 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:15.613331 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09d47331-f1a1-4241-b508-78286b46c638 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.613796 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09d47331-f1a1-4241-b508-78286b46c638 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.614821 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09d47331-f1a1-4241-b508-78286b46c638 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.615468 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-09d47331-f1a1-4241-b508-78286b46c638 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:16.128696 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-29e23dc8-f94d-44a4-ad00-c1a715cc4598 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:16.137162 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-29e23dc8-f94d-44a4-ad00-c1a715cc4598 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1365 microversion: 2.1 time: 0.644615 Aug 01 14:15:16.148315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 377/772] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:15 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1365 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:16.148315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:16.148315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:16.156136 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:16.156136 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:16.156136 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:16.156136 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:16.157320 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-09d47331-f1a1-4241-b508-78286b46c638 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:16.170752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-09d47331-f1a1-4241-b508-78286b46c638 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1453 microversion: 2.1 time: 0.574572 Aug 01 14:15:16.171801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 396/773] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:15 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1453 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:16.452163 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-be6c1491-74c6-4029-bbb5-2714c794b2d9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:16.452935 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-be6c1491-74c6-4029-bbb5-2714c794b2d9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:16.460101 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be6c1491-74c6-4029-bbb5-2714c794b2d9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:16.461025 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be6c1491-74c6-4029-bbb5-2714c794b2d9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:16.462444 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be6c1491-74c6-4029-bbb5-2714c794b2d9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:16.463240 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be6c1491-74c6-4029-bbb5-2714c794b2d9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:16.490395 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:16.504642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:16.522530 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:16.524385 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:16.525648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3715a5eb-cdac-4fb8-b9c8-17d85420ccb3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.386710 Aug 01 14:15:16.526417 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 378/774] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:16 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:16.760672 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-be6c1491-74c6-4029-bbb5-2714c794b2d9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:16.772533 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-be6c1491-74c6-4029-bbb5-2714c794b2d9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.324930 Aug 01 14:15:16.773229 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 397/775] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:16 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:17.165416 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8065fc31-6270-4c5f-bd9c-c02dd6c63965 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:17.167107 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8065fc31-6270-4c5f-bd9c-c02dd6c63965 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:17.175453 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8065fc31-6270-4c5f-bd9c-c02dd6c63965 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:17.176247 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8065fc31-6270-4c5f-bd9c-c02dd6c63965 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:17.177280 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8065fc31-6270-4c5f-bd9c-c02dd6c63965 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:17.177874 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8065fc31-6270-4c5f-bd9c-c02dd6c63965 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:17.339785 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8065fc31-6270-4c5f-bd9c-c02dd6c63965 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:17.348116 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8065fc31-6270-4c5f-bd9c-c02dd6c63965 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1365 microversion: 2.1 time: 0.188657 Aug 01 14:15:17.348874 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 379/776] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:17 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:17.558300 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:17.559617 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:17.571826 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:17.572521 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:17.573599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:17.574306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:17.794952 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3c37b0c0-9b93-49a2-9508-cb73726eca53 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:17.795724 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3c37b0c0-9b93-49a2-9508-cb73726eca53 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:17.802312 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c37b0c0-9b93-49a2-9508-cb73726eca53 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:17.802635 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c37b0c0-9b93-49a2-9508-cb73726eca53 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:17.803426 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c37b0c0-9b93-49a2-9508-cb73726eca53 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:17.803856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c37b0c0-9b93-49a2-9508-cb73726eca53 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:17.807750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:17.820161 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:17.821719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:17.823436 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-849215bf-4286-4f78-b8c0-2230005cec89 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.274475 Aug 01 14:15:17.824199 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 398/777] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:17 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:17.959050 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3c37b0c0-9b93-49a2-9508-cb73726eca53 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:17.967847 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3c37b0c0-9b93-49a2-9508-cb73726eca53 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.177370 Aug 01 14:15:17.968508 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 380/778] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:17 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:18.372738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dc74e825-8b55-409a-ab88-f18234f73990 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:18.373461 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dc74e825-8b55-409a-ab88-f18234f73990 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:18.383840 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc74e825-8b55-409a-ab88-f18234f73990 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:18.383840 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc74e825-8b55-409a-ab88-f18234f73990 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:18.383840 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc74e825-8b55-409a-ab88-f18234f73990 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:18.383840 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc74e825-8b55-409a-ab88-f18234f73990 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:18.492202 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-94a9dd47-2ea5-40c2-9f32-64eacdd8f922 req-3a405ee8-607b-4c6d-aa5e-2cd6facfb82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1842e4-dc37-4e0d-b172-23f29125f8d0", "tag": "b550f9ea-8012-4b81-8b79-2ea6bb8e8012"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:18.503750 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-94a9dd47-2ea5-40c2-9f32-64eacdd8f922 req-3a405ee8-607b-4c6d-aa5e-2cd6facfb82e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:18.504500 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-94a9dd47-2ea5-40c2-9f32-64eacdd8f922 req-3a405ee8-607b-4c6d-aa5e-2cd6facfb82e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:18.519415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-94a9dd47-2ea5-40c2-9f32-64eacdd8f922 req-3a405ee8-607b-4c6d-aa5e-2cd6facfb82e service nova] Creating event network-changed:b550f9ea-8012-4b81-8b79-2ea6bb8e8012 for instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 on hv-cinder-84517 Aug 01 14:15:18.525331 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-94a9dd47-2ea5-40c2-9f32-64eacdd8f922 req-3a405ee8-607b-4c6d-aa5e-2cd6facfb82e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036567 Aug 01 14:15:18.526730 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 381/779] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:18.559300 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dc74e825-8b55-409a-ab88-f18234f73990 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:18.574190 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dc74e825-8b55-409a-ab88-f18234f73990 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1365 microversion: 2.1 time: 0.207866 Aug 01 14:15:18.576004 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 399/780] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:18 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:18.848698 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:18.850179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:18.858504 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:18.859344 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:18.860424 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:18.860908 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:18.996673 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dfe3453e-1386-46f1-9317-dd61b5af04af tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:18.998048 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dfe3453e-1386-46f1-9317-dd61b5af04af tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:19.005386 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dfe3453e-1386-46f1-9317-dd61b5af04af tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:19.005923 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dfe3453e-1386-46f1-9317-dd61b5af04af tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:19.006804 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dfe3453e-1386-46f1-9317-dd61b5af04af tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:19.007771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dfe3453e-1386-46f1-9317-dd61b5af04af tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:19.158167 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:19.170688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:19.172807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:19.174255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a035d791-ac15-4acc-ab0d-0f67ef7c9180 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.330345 Aug 01 14:15:19.175798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 382/781] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:18 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:19.227617 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dfe3453e-1386-46f1-9317-dd61b5af04af tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:19.239615 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dfe3453e-1386-46f1-9317-dd61b5af04af tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.247738 Aug 01 14:15:19.240254 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 400/782] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:18 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:19.601519 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f17bbe28-8d56-474c-84de-f2bd807a5eb6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:19.604816 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f17bbe28-8d56-474c-84de-f2bd807a5eb6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:19.604816 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:19.605764 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=6 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:19.613024 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f17bbe28-8d56-474c-84de-f2bd807a5eb6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:19.613472 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f17bbe28-8d56-474c-84de-f2bd807a5eb6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:19.614257 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f17bbe28-8d56-474c-84de-f2bd807a5eb6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:19.614681 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f17bbe28-8d56-474c-84de-f2bd807a5eb6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:19.766948 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f17bbe28-8d56-474c-84de-f2bd807a5eb6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:19.779159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f17bbe28-8d56-474c-84de-f2bd807a5eb6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1365 microversion: 2.1 time: 0.183078 Aug 01 14:15:19.779612 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 383/783] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:19 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:20.199427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:20.200065 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:20.201955 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:20.208723 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:20.209127 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:20.210285 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:20.210841 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:20.263808 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d728f0c0-99ac-4500-94cd-dba988a3cf91 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:20.264488 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d728f0c0-99ac-4500-94cd-dba988a3cf91 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:20.271031 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d728f0c0-99ac-4500-94cd-dba988a3cf91 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:20.271825 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d728f0c0-99ac-4500-94cd-dba988a3cf91 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:20.272704 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d728f0c0-99ac-4500-94cd-dba988a3cf91 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:20.273132 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d728f0c0-99ac-4500-94cd-dba988a3cf91 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:20.419551 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:20.429153 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:20.430656 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:20.431881 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-478e9e4a-c5f5-4da9-89a6-7134407ec4a5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.236511 Aug 01 14:15:20.432498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 401/784] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:20 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:20.746191 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d728f0c0-99ac-4500-94cd-dba988a3cf91 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:20.755753 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d728f0c0-99ac-4500-94cd-dba988a3cf91 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.497402 Aug 01 14:15:20.756590 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 384/785] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:20 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:20.802067 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bd948b7d-fdb0-483e-bc34-a98f113c5217 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:20.802671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bd948b7d-fdb0-483e-bc34-a98f113c5217 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:20.810302 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd948b7d-fdb0-483e-bc34-a98f113c5217 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:20.810759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd948b7d-fdb0-483e-bc34-a98f113c5217 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:20.811764 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd948b7d-fdb0-483e-bc34-a98f113c5217 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:20.812505 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd948b7d-fdb0-483e-bc34-a98f113c5217 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:20.953990 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bd948b7d-fdb0-483e-bc34-a98f113c5217 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:20.961896 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bd948b7d-fdb0-483e-bc34-a98f113c5217 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1365 microversion: 2.1 time: 0.163991 Aug 01 14:15:20.962499 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 402/786] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:20 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:21.454798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:21.455392 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:21.462562 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.463000 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.463770 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.464190 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.614304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:21.623708 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:21.625249 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:21.626428 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f613d791-f5ab-4c6b-a947-04e047d6fb1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.175726 Aug 01 14:15:21.627009 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 385/787] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:21 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:21.782209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-808e7dca-2049-4a7a-bcde-eb14ad653026 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:21.783070 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-808e7dca-2049-4a7a-bcde-eb14ad653026 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:21.792037 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-808e7dca-2049-4a7a-bcde-eb14ad653026 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.792707 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-808e7dca-2049-4a7a-bcde-eb14ad653026 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.793525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-808e7dca-2049-4a7a-bcde-eb14ad653026 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.793959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-808e7dca-2049-4a7a-bcde-eb14ad653026 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.987586 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d3528fd9-09c9-4db4-9f98-94a8d2b8cd5a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:21.988254 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d3528fd9-09c9-4db4-9f98-94a8d2b8cd5a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:21.994071 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-808e7dca-2049-4a7a-bcde-eb14ad653026 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:22.003594 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-808e7dca-2049-4a7a-bcde-eb14ad653026 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.225155 Aug 01 14:15:22.004195 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 403/788] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:21 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:22.012418 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3528fd9-09c9-4db4-9f98-94a8d2b8cd5a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:22.020222 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3528fd9-09c9-4db4-9f98-94a8d2b8cd5a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:22.020222 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3528fd9-09c9-4db4-9f98-94a8d2b8cd5a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:22.020222 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d3528fd9-09c9-4db4-9f98-94a8d2b8cd5a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:22.204944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d3528fd9-09c9-4db4-9f98-94a8d2b8cd5a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:22.215567 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d3528fd9-09c9-4db4-9f98-94a8d2b8cd5a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1365 microversion: 2.1 time: 0.235698 Aug 01 14:15:22.217524 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 386/789] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:21 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:22.652948 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:22.653752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:22.662167 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:22.662654 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:22.663494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:22.664329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:22.918386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-45be86c9-b788-4120-bd1c-265f1b26a02d req-808881b0-f91d-4b35-a2ac-a207ce560662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730a6765-52cd-4528-9957-3165769c0820", "name": "network-vif-plugged", "status": "completed", "tag": "84a9217a-963b-4cc2-9c3d-d50aea2772d1"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:22.938151 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-45be86c9-b788-4120-bd1c-265f1b26a02d req-808881b0-f91d-4b35-a2ac-a207ce560662 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:22.939041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-45be86c9-b788-4120-bd1c-265f1b26a02d req-808881b0-f91d-4b35-a2ac-a207ce560662 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:22.961694 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-45be86c9-b788-4120-bd1c-265f1b26a02d req-808881b0-f91d-4b35-a2ac-a207ce560662 service nova] Creating event network-vif-plugged:84a9217a-963b-4cc2-9c3d-d50aea2772d1 for instance 730a6765-52cd-4528-9957-3165769c0820 on hv-cinder-84517 Aug 01 14:15:22.972221 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-45be86c9-b788-4120-bd1c-265f1b26a02d req-808881b0-f91d-4b35-a2ac-a207ce560662 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061183 Aug 01 14:15:22.973845 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 387/790] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:15:23.028041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-26d1787b-cadc-400f-bb14-def3f0664642 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:23.029009 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-26d1787b-cadc-400f-bb14-def3f0664642 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:23.042100 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:23.047523 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-26d1787b-cadc-400f-bb14-def3f0664642 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:23.049025 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-26d1787b-cadc-400f-bb14-def3f0664642 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:23.049847 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-26d1787b-cadc-400f-bb14-def3f0664642 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:23.050291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-26d1787b-cadc-400f-bb14-def3f0664642 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:23.068710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:23.071986 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:23.079565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-190a5fcf-5fed-45c2-b4e8-73e77666cbd2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.431811 Aug 01 14:15:23.083787 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 404/791] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:22 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:23.253854 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e90e0180-45c6-4b41-9582-d0b0f153a764 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:23.254464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e90e0180-45c6-4b41-9582-d0b0f153a764 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:23.262977 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e90e0180-45c6-4b41-9582-d0b0f153a764 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:23.263419 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e90e0180-45c6-4b41-9582-d0b0f153a764 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:23.264201 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e90e0180-45c6-4b41-9582-d0b0f153a764 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:23.264743 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e90e0180-45c6-4b41-9582-d0b0f153a764 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:23.307119 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-26d1787b-cadc-400f-bb14-def3f0664642 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:23.317649 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-26d1787b-cadc-400f-bb14-def3f0664642 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.295364 Aug 01 14:15:23.318304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 388/792] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:23 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:23.442938 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e90e0180-45c6-4b41-9582-d0b0f153a764 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:23.455392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e90e0180-45c6-4b41-9582-d0b0f153a764 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1365 microversion: 2.1 time: 0.204559 Aug 01 14:15:23.456696 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 405/793] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:23 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:24.109650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:24.109650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:24.114246 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:24.114726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:24.115505 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:24.115933 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:24.312971 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:24.322313 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:24.323727 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:24.325003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a6790d2c-4f01-4974-8880-ba2b81bdb37c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.222395 Aug 01 14:15:24.326774 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 389/794] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:24 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:24.342113 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4f5dcfb4-66be-4c3f-a488-f73c5701e87b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:24.342800 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4f5dcfb4-66be-4c3f-a488-f73c5701e87b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:24.351176 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f5dcfb4-66be-4c3f-a488-f73c5701e87b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:24.351624 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f5dcfb4-66be-4c3f-a488-f73c5701e87b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:24.352455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f5dcfb4-66be-4c3f-a488-f73c5701e87b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:24.352889 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f5dcfb4-66be-4c3f-a488-f73c5701e87b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:24.483471 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-76a320dd-1b3c-42d8-ba2b-fe3571b5ed36 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:24.484088 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-76a320dd-1b3c-42d8-ba2b-fe3571b5ed36 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:24.490905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-76a320dd-1b3c-42d8-ba2b-fe3571b5ed36 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:24.491395 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-76a320dd-1b3c-42d8-ba2b-fe3571b5ed36 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:24.492170 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-76a320dd-1b3c-42d8-ba2b-fe3571b5ed36 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:24.492668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-76a320dd-1b3c-42d8-ba2b-fe3571b5ed36 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:24.497631 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:24.533807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4f5dcfb4-66be-4c3f-a488-f73c5701e87b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:24.545297 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4f5dcfb4-66be-4c3f-a488-f73c5701e87b tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.207579 Aug 01 14:15:24.549720 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 406/795] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:24 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:24.648616 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-76a320dd-1b3c-42d8-ba2b-fe3571b5ed36 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:24.657133 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-76a320dd-1b3c-42d8-ba2b-fe3571b5ed36 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1365 microversion: 2.1 time: 0.178026 Aug 01 14:15:24.657735 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 390/796] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:24 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:25.351729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:25.352703 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:25.359503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.360154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:25.360982 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.361420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:25.537218 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:25.552547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:25.552547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:25.555948 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-08257cac-3bba-440e-a6e6-97bf9568ee76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.209352 Aug 01 14:15:25.556713 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 407/797] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:25 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:25.568263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-99b31da3-27b1-48e0-b319-5890127f553c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:25.569940 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-99b31da3-27b1-48e0-b319-5890127f553c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:25.579579 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99b31da3-27b1-48e0-b319-5890127f553c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.580026 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99b31da3-27b1-48e0-b319-5890127f553c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:25.580924 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99b31da3-27b1-48e0-b319-5890127f553c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.582009 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99b31da3-27b1-48e0-b319-5890127f553c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:25.682718 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cdc95b2e-d5bc-4765-82b8-e597955c0c22 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:25.683409 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cdc95b2e-d5bc-4765-82b8-e597955c0c22 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:25.690050 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cdc95b2e-d5bc-4765-82b8-e597955c0c22 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.690491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cdc95b2e-d5bc-4765-82b8-e597955c0c22 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:25.691264 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cdc95b2e-d5bc-4765-82b8-e597955c0c22 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.691683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cdc95b2e-d5bc-4765-82b8-e597955c0c22 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:25.795855 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-99b31da3-27b1-48e0-b319-5890127f553c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:25.807170 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-99b31da3-27b1-48e0-b319-5890127f553c tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.244220 Aug 01 14:15:25.807709 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 391/798] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:25 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:25.886232 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cdc95b2e-d5bc-4765-82b8-e597955c0c22 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:25.898573 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cdc95b2e-d5bc-4765-82b8-e597955c0c22 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1555 microversion: 2.1 time: 0.221570 Aug 01 14:15:25.901670 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 408/799] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:25 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:25.923364 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9e5bbb05-e2f2-4a68-ad28-106e3a1c0044 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:25.924126 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-9e5bbb05-e2f2-4a68-ad28-106e3a1c0044 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:25.931164 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9e5bbb05-e2f2-4a68-ad28-106e3a1c0044 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.931603 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9e5bbb05-e2f2-4a68-ad28-106e3a1c0044 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:25.932815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9e5bbb05-e2f2-4a68-ad28-106e3a1c0044 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.933557 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9e5bbb05-e2f2-4a68-ad28-106e3a1c0044 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:26.237924 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9e5bbb05-e2f2-4a68-ad28-106e3a1c0044 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.318821 Aug 01 14:15:26.238524 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 392/800] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 14:15:25 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-interface => generated 284 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:26.581854 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:26.582525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:26.590021 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:26.590577 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:26.591434 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:26.591875 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:26.830620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3676bd35-5ba0-4328-b543-e8528ec093ff tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:26.831512 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3676bd35-5ba0-4328-b543-e8528ec093ff tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:26.847551 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3676bd35-5ba0-4328-b543-e8528ec093ff tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:26.848884 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3676bd35-5ba0-4328-b543-e8528ec093ff tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:26.851780 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3676bd35-5ba0-4328-b543-e8528ec093ff tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:26.853383 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3676bd35-5ba0-4328-b543-e8528ec093ff tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:26.900316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:26.917930 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:26.919561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:26.920823 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-05c4b69b-47dd-4dff-ba8c-b5aebb74489b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.344306 Aug 01 14:15:26.921414 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 409/801] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:26 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:27.118203 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3676bd35-5ba0-4328-b543-e8528ec093ff tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:27.130411 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3676bd35-5ba0-4328-b543-e8528ec093ff tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.304649 Aug 01 14:15:27.132776 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 393/802] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:26 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:27.720578 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-352d41c7-500c-4cf9-b986-6317f9c75ea9 req-06f158a7-d748-4ed6-a1d3-d9e913ed9020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730a6765-52cd-4528-9957-3165769c0820", "tag": "84a9217a-963b-4cc2-9c3d-d50aea2772d1"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:27.731511 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:27.733894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-352d41c7-500c-4cf9-b986-6317f9c75ea9 req-06f158a7-d748-4ed6-a1d3-d9e913ed9020 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:27.734347 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-352d41c7-500c-4cf9-b986-6317f9c75ea9 req-06f158a7-d748-4ed6-a1d3-d9e913ed9020 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:27.752019 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-352d41c7-500c-4cf9-b986-6317f9c75ea9 req-06f158a7-d748-4ed6-a1d3-d9e913ed9020 service nova] Creating event network-changed:84a9217a-963b-4cc2-9c3d-d50aea2772d1 for instance 730a6765-52cd-4528-9957-3165769c0820 on hv-cinder-84517 Aug 01 14:15:27.761866 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-352d41c7-500c-4cf9-b986-6317f9c75ea9 req-06f158a7-d748-4ed6-a1d3-d9e913ed9020 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044516 Aug 01 14:15:27.769740 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 410/803] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:27.963528 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:27.964198 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:27.976989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:27.978158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:27.979783 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:27.980577 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:28.155448 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-94f58826-1508-4c03-8882-901a201048d6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:28.156708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-94f58826-1508-4c03-8882-901a201048d6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:28.169932 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-94f58826-1508-4c03-8882-901a201048d6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:28.170825 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-94f58826-1508-4c03-8882-901a201048d6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:28.172230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-94f58826-1508-4c03-8882-901a201048d6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:28.173610 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-94f58826-1508-4c03-8882-901a201048d6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:28.234169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:28.244050 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:28.258380 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:28.259715 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a86e956c-af6c-4c7f-81d7-5aaa041759b3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.301118 Aug 01 14:15:28.260642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 394/804] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:27 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:28.433263 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-94f58826-1508-4c03-8882-901a201048d6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:28.445090 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-94f58826-1508-4c03-8882-901a201048d6 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.295605 Aug 01 14:15:28.445888 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 411/805] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:28 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:29.039787 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-a34ce751-9748-4042-a917-f0c0b43898b4 req-7163ef42-04e3-4861-995f-0f3bac91d7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38da3c04-7cad-47ab-b253-e133bdeb480c", "name": "network-vif-plugged", "status": "completed", "tag": "ec79e886-ddb7-4769-af78-cfcf4186343e"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:29.051259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-a34ce751-9748-4042-a917-f0c0b43898b4 req-7163ef42-04e3-4861-995f-0f3bac91d7b6 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:29.051868 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-a34ce751-9748-4042-a917-f0c0b43898b4 req-7163ef42-04e3-4861-995f-0f3bac91d7b6 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:29.070201 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-a34ce751-9748-4042-a917-f0c0b43898b4 req-7163ef42-04e3-4861-995f-0f3bac91d7b6 service nova] Creating event network-vif-plugged:ec79e886-ddb7-4769-af78-cfcf4186343e for instance 38da3c04-7cad-47ab-b253-e133bdeb480c on hv-cinder-84517 Aug 01 14:15:29.078483 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-a34ce751-9748-4042-a917-f0c0b43898b4 req-7163ef42-04e3-4861-995f-0f3bac91d7b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043597 Aug 01 14:15:29.079080 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 395/806] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:29.295673 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:29.297357 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:29.304374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:29.304823 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:29.305616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:29.306042 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:29.483601 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bbaeef5b-b7f8-4fd1-82d5-c54c56f49dd9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:29.484746 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bbaeef5b-b7f8-4fd1-82d5-c54c56f49dd9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:29.492478 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbaeef5b-b7f8-4fd1-82d5-c54c56f49dd9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:29.493224 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbaeef5b-b7f8-4fd1-82d5-c54c56f49dd9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:29.494359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbaeef5b-b7f8-4fd1-82d5-c54c56f49dd9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:29.494793 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bbaeef5b-b7f8-4fd1-82d5-c54c56f49dd9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:29.496910 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:29.511464 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:29.513390 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:29.514949 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-48cb96b0-dca5-47dc-8089-d9a6bf091fde tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.224758 Aug 01 14:15:29.515900 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 412/807] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:29 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:29.659551 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bbaeef5b-b7f8-4fd1-82d5-c54c56f49dd9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:29.669251 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bbaeef5b-b7f8-4fd1-82d5-c54c56f49dd9 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.193182 Aug 01 14:15:29.669849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 396/808] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:29 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:30.541663 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:30.542287 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:30.549700 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:30.550143 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:30.550907 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:30.551361 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:30.693330 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-731c0ba0-d6ae-45cd-9b7c-eee05e94637f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:30.694370 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-731c0ba0-d6ae-45cd-9b7c-eee05e94637f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:30.695508 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:30.698419 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:30.708461 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-731c0ba0-d6ae-45cd-9b7c-eee05e94637f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:30.709155 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-731c0ba0-d6ae-45cd-9b7c-eee05e94637f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:30.709366 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:30.710414 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-731c0ba0-d6ae-45cd-9b7c-eee05e94637f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:30.711118 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-731c0ba0-d6ae-45cd-9b7c-eee05e94637f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:30.712116 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:30.714400 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-11a2f0c2-fa7a-49d7-90a6-7863cf9e17e1 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1740 microversion: 2.20 time: 0.176945 Aug 01 14:15:30.715365 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 413/809] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:30 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:30.883468 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-731c0ba0-d6ae-45cd-9b7c-eee05e94637f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:30.893057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-731c0ba0-d6ae-45cd-9b7c-eee05e94637f tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1574 microversion: 2.1 time: 0.204967 Aug 01 14:15:30.893747 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 397/810] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:30 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:31.742869 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:31.743503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:31.750491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:31.750923 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:31.751681 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:31.752104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:31.900009 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:31.902494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:31.910772 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:31.913191 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:31.915394 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-59295e6d-58fa-4e7f-9bf6-48f91fec027b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1740 microversion: 2.20 time: 0.176439 Aug 01 14:15:31.916298 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 414/811] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:31 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:31.918283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0d00a39d-7206-4655-9028-7b65ebc0f894 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:31.919443 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0d00a39d-7206-4655-9028-7b65ebc0f894 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:31.929068 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d00a39d-7206-4655-9028-7b65ebc0f894 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:31.929514 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d00a39d-7206-4655-9028-7b65ebc0f894 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:31.930279 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d00a39d-7206-4655-9028-7b65ebc0f894 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:31.930704 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0d00a39d-7206-4655-9028-7b65ebc0f894 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:32.083926 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0d00a39d-7206-4655-9028-7b65ebc0f894 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:32.091861 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0d00a39d-7206-4655-9028-7b65ebc0f894 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1561 microversion: 2.1 time: 0.180248 Aug 01 14:15:32.092483 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 398/812] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:31 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:32.942745 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:32.943749 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:32.951306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:32.951755 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:32.952676 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:32.953119 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:33.121062 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:33.129516 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:33.131105 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:33.132303 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-aaf1bdc3-ae2a-48a7-b503-ccf9c45033db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1735 microversion: 2.20 time: 0.193583 Aug 01 14:15:33.132879 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 415/813] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:32 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:34.155659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:34.156466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:34.164715 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:34.165174 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:34.165998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:34.166537 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:34.343512 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:34.354020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:34.356109 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:34.357831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-67f7e19a-a62b-401d-9556-edbc39138444 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1735 microversion: 2.20 time: 0.206479 Aug 01 14:15:34.358614 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 399/814] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:34 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:35.096072 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-648d36de-f15a-43fd-b788-d74270226d46 req-a326a0e9-5976-4a24-8a4e-832319c165c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2880642-059e-4718-b9ed-becd8b1dad8c", "name": "network-vif-plugged", "status": "completed", "tag": "6f4bdd7e-2b10-4789-8e67-555594e488b6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:35.117648 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-648d36de-f15a-43fd-b788-d74270226d46 req-a326a0e9-5976-4a24-8a4e-832319c165c4 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:35.118655 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-648d36de-f15a-43fd-b788-d74270226d46 req-a326a0e9-5976-4a24-8a4e-832319c165c4 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:35.135562 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-648d36de-f15a-43fd-b788-d74270226d46 req-a326a0e9-5976-4a24-8a4e-832319c165c4 service nova] Creating event network-vif-plugged:6f4bdd7e-2b10-4789-8e67-555594e488b6 for instance a2880642-059e-4718-b9ed-becd8b1dad8c on hv-cinder-84517 Aug 01 14:15:35.141693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-648d36de-f15a-43fd-b788-d74270226d46 req-a326a0e9-5976-4a24-8a4e-832319c165c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051748 Aug 01 14:15:35.142979 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 416/815] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:35.386787 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:35.387858 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:35.397319 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:35.398427 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:35.399463 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:35.400128 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:35.583055 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:35.592265 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:35.594351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:35.595652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8b6235b2-1722-418d-bc38-4f3ad7e53ddf tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1735 microversion: 2.20 time: 0.215243 Aug 01 14:15:35.596851 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 400/816] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:35 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:36.630345 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:36.631496 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:36.651344 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:36.652058 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:36.653084 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:36.653700 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:36.856153 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:36.875276 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:36.877001 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:36.878673 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-12e421da-a7fe-48fe-9bc9-e32c70296d98 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1735 microversion: 2.20 time: 0.253355 Aug 01 14:15:36.879883 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 417/817] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:36 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:37.916435 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:37.917809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:37.926751 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:37.927403 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:37.928690 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:37.929384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:38.090568 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:38.100779 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:38.103684 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:38.103684 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-36ded63a-ea37-4904-9ba6-d7446ca71d6c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1735 microversion: 2.20 time: 0.192640 Aug 01 14:15:38.104356 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 401/818] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:37 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:39.128544 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:39.129177 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:39.136832 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:39.137280 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:39.138064 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:39.138687 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:39.329815 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:39.339228 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:39.341068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:39.342544 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-af3eb01b-0a0b-441e-afbb-c642d82171db tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1735 microversion: 2.20 time: 0.218473 Aug 01 14:15:39.357974 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 418/819] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:39 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:40.378901 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:40.381446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:40.401001 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:40.402350 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:40.404111 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:40.406598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:40.631640 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:40.653668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:40.659308 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:40.664156 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1cddbd04-c078-4009-adcd-304d18f31172 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1735 microversion: 2.20 time: 0.293326 Aug 01 14:15:40.665799 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 402/820] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:40 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1735 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:41.693779 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:41.694677 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:41.705624 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:41.706160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:41.710256 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:41.710752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:41.888753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:41.899797 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:41.901583 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:41.902823 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-937a91c6-becc-4341-924a-2d954a87a2b7 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1735 microversion: 2.20 time: 0.213337 Aug 01 14:15:41.903407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 419/821] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:41 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:42.926092 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:42.926734 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:42.934210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:42.934657 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:42.935414 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:42.935841 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:43.094730 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:43.103537 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:43.105083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:43.106277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5239de2b-c064-4cbe-8c9a-f9fb6a7b8495 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1735 microversion: 2.20 time: 0.184289 Aug 01 14:15:43.106876 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 403/822] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:42 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:44.129587 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:44.130267 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:44.137479 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:44.137925 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:44.138688 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:44.139419 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:44.285508 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:44.297545 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:44.298853 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:44.300022 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c549d0d9-798f-4fc9-a7bf-7ac5f106b312 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1717 microversion: 2.20 time: 0.174578 Aug 01 14:15:44.300623 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 420/823] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:44 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:45.323981 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:45.324609 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:45.331516 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.331989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.332782 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.333206 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.472431 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:45.482855 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:45.484998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:45.486563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-38971321-b0b6-45d0-b73b-b7151d32983f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1717 microversion: 2.20 time: 0.166571 Aug 01 14:15:45.487150 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 404/824] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:45 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:46.512034 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:46.512662 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:46.519504 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:46.519966 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:46.521671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:46.521671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:46.731090 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:46.739407 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:46.741109 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:46.742329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ea6e1076-6806-4ec7-af79-d9be90a5e33c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1660 microversion: 2.20 time: 0.234892 Aug 01 14:15:46.743085 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 421/825] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:46 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1660 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:46.768598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-48ae074f-f0ad-4618-92b7-53b94f6c96f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1af8f64d-8720-4973-a296-4803c513c8ca"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:46.771071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-48ae074f-f0ad-4618-92b7-53b94f6c96f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:46.778542 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48ae074f-f0ad-4618-92b7-53b94f6c96f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:46.779043 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48ae074f-f0ad-4618-92b7-53b94f6c96f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:46.779733 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48ae074f-f0ad-4618-92b7-53b94f6c96f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:46.780140 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-48ae074f-f0ad-4618-92b7-53b94f6c96f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:46.990684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-8fa2d9b6-2e65-4372-8b2f-ea77f0f6373a req-0c9d83c6-411d-47f6-8539-aaa498bab46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2880642-059e-4718-b9ed-becd8b1dad8c", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4bdd7e-2b10-4789-8e67-555594e488b6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:47.002991 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-8fa2d9b6-2e65-4372-8b2f-ea77f0f6373a req-0c9d83c6-411d-47f6-8539-aaa498bab46c service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:47.003494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-8fa2d9b6-2e65-4372-8b2f-ea77f0f6373a req-0c9d83c6-411d-47f6-8539-aaa498bab46c service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:47.017325 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.compute.server_external_events [req-8fa2d9b6-2e65-4372-8b2f-ea77f0f6373a req-0c9d83c6-411d-47f6-8539-aaa498bab46c service nova] Unable to find a host for instance a2880642-059e-4718-b9ed-becd8b1dad8c. Dropping event network-vif-unplugged {{(pid=118111) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 14:15:47.019241 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-8fa2d9b6-2e65-4372-8b2f-ea77f0f6373a req-0c9d83c6-411d-47f6-8539-aaa498bab46c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032576 Aug 01 14:15:47.020227 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 422/826] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 01 14:15:47.069941 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:47.168379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-48ae074f-f0ad-4618-92b7-53b94f6c96f9 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.404139 Aug 01 14:15:47.172322 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 405/827] 10.222.0.45 () {62 vars in 1364 bytes} [Mon Aug 1 14:15:46 2022] POST /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/os-volume_attachments => generated 188 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:15:47.318178 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bdd73b58-96d4-4163-abe8-43bad633dd64 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:47.318992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bdd73b58-96d4-4163-abe8-43bad633dd64 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:47.328103 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bdd73b58-96d4-4163-abe8-43bad633dd64 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:47.328739 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bdd73b58-96d4-4163-abe8-43bad633dd64 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:47.329657 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bdd73b58-96d4-4163-abe8-43bad633dd64 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:47.330095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bdd73b58-96d4-4163-abe8-43bad633dd64 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:47.604258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bdd73b58-96d4-4163-abe8-43bad633dd64 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/os-volume_attachments/1af8f64d-8720-4973-a296-4803c513c8ca" status: 202 len: 0 microversion: 2.20 time: 0.291391 Aug 01 14:15:47.605110 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 423/828] 10.222.0.45 () {60 vars in 1457 bytes} [Mon Aug 1 14:15:47 2022] DELETE /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/os-volume_attachments/1af8f64d-8720-4973-a296-4803c513c8ca => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:15:47.678082 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b1f65af8-f1f3-45ac-ba19-7c65affd1e52 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:47.678834 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b1f65af8-f1f3-45ac-ba19-7c65affd1e52 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:47.686769 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1f65af8-f1f3-45ac-ba19-7c65affd1e52 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:47.687438 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1f65af8-f1f3-45ac-ba19-7c65affd1e52 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:47.688218 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1f65af8-f1f3-45ac-ba19-7c65affd1e52 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:47.688782 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b1f65af8-f1f3-45ac-ba19-7c65affd1e52 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:47.721988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b1f65af8-f1f3-45ac-ba19-7c65affd1e52 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118110) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:15:47.797659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b1f65af8-f1f3-45ac-ba19-7c65affd1e52 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "POST /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/action" status: 202 len: 0 microversion: 2.20 time: 0.125189 Aug 01 14:15:47.798299 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 406/829] 10.222.0.45 () {62 vars in 1319 bytes} [Mon Aug 1 14:15:47 2022] POST /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:15:47.808300 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:47.809424 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:47.816585 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:47.817526 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:47.819077 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:47.820036 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:47.974527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:47.984070 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:47.985708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:47.987137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8ca32ae0-c0e3-460a-b232-c8b90239b49c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1668 microversion: 2.20 time: 0.184541 Aug 01 14:15:47.988002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 424/830] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:47 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1668 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:49.033251 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:49.034495 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:49.047041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:49.047940 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:49.049286 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:49.050837 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:49.215055 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:49.225246 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:49.226883 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:49.228387 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-394b42f9-4a3e-42a5-91f6-5af3c2bdbc4a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1668 microversion: 2.20 time: 0.207124 Aug 01 14:15:49.228974 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 407/831] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:49 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1668 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:50.254348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:50.254822 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:50.261922 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:50.262376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:50.263180 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:50.263634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:50.467329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:50.480253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:50.480253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:50.480253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dc0a4be0-af07-4443-90fe-dfed8ee476cb tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.230701 Aug 01 14:15:50.492952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 425/832] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:50 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:51.514082 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:51.516024 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:51.530880 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:51.531951 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:51.533293 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:51.534039 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:51.743237 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:51.751995 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:51.753752 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:51.755114 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d317ac08-7fb6-4bd3-9098-f8804535177e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.249174 Aug 01 14:15:51.755802 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 408/833] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:51 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:52.779691 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:52.780422 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:52.787294 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:52.787741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:52.788601 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:52.789038 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:52.957610 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:52.966194 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:52.967927 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:52.969176 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-750d8cc8-c51e-4474-9305-9ce9bfef700f tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.193912 Aug 01 14:15:52.970257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 426/834] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:52 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:54.002327 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:54.003029 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:54.012481 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:54.012932 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:54.013715 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:54.014152 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:54.165306 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:54.174474 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:54.176501 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:54.178301 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-90e2c985-39a9-4e0d-9da6-3d8c0d34b93e tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.187443 Aug 01 14:15:54.179391 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 409/835] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:53 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:55.203158 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:55.204556 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:55.212922 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.213348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.214142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.214568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.366747 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:55.377846 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:55.379859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:55.381266 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-af7a92f3-a355-4adb-91dd-4f821ead0015 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.182007 Aug 01 14:15:55.382251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 427/836] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:55 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:56.408968 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:56.409981 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:56.418627 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:56.419371 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:56.420484 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:56.421146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:56.609594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:56.625770 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:56.631082 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:56.634067 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-afac61d0-58e2-4d3b-b672-b80b4a6aaab5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.231581 Aug 01 14:15:56.635902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 410/837] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:56 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:57.661781 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:57.662530 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:57.676579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:57.677553 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:57.678934 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:57.679647 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:57.935268 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:57.945268 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:57.947561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:57.949733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0f9940a2-52c3-4661-9dc4-5306b4108a61 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.292067 Aug 01 14:15:57.950844 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 428/838] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:57 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:15:58.984418 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:58.985832 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:58.995228 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:58.995966 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:58.996975 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:58.997564 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:59.184493 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:59.198117 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:59.201189 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:59.204165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4be9a18e-a2bb-434d-9b5c-3d12106455f5 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.222884 Aug 01 14:15:59.205708 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 411/839] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:58 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:00.238784 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:00.240261 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:00.246528 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=38 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:00.248911 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:00.249367 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:00.250151 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:00.250792 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:00.409051 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:00.419200 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:00.420791 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:00.421967 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1cd7f4cb-f98f-4f3d-88e6-6f237055840b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.187338 Aug 01 14:16:00.422606 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 429/840] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:00 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:01.453384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:01.454442 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:01.457317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:01.463993 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:01.464516 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:01.465347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:01.465779 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:01.639718 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:01.650164 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:01.652071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:01.653426 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0fcd0e2c-c3d9-4c18-b7eb-4fa5d0df46ed tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.206411 Aug 01 14:16:01.654563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 412/841] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:01 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:02.681578 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:02.682226 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:02.689246 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:02.689654 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:02.690449 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:02.690848 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:02.695732 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:02.878888 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:02.888124 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:02.889697 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:02.890906 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-89d23110-3f27-453d-9b2a-6c5be74fa50c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.213563 Aug 01 14:16:02.891494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 430/842] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:02 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:03.914839 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:03.915460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:03.922813 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:03.923261 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:03.924051 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:03.924532 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:04.071173 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:04.079856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:04.081384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:04.082641 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c0a37c71-2cee-4498-bcea-af49220a0ba2 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.172206 Aug 01 14:16:04.083192 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 413/843] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:03 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:05.106715 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:05.107685 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:05.115134 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:05.115705 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:05.116555 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:05.116993 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:05.283169 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:05.296031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:05.297738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:05.299049 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e38faaea-ec36-4a07-8870-d7257be59e76 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.196400 Aug 01 14:16:05.299685 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 431/844] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:05 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:06.325454 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:06.326501 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:06.336404 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.336896 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.337753 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.338285 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.502234 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:06.511010 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:06.512594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:06.513980 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4f3c34dd-efd3-465b-854f-02c459a93977 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.195399 Aug 01 14:16:06.514597 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 414/845] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:06 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:07.063080 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-8c1219c9-2218-494d-ad43-c49d9fde30db req-a3a2dc80-a861-44ac-8cb7-39a232d9755b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2880642-059e-4718-b9ed-becd8b1dad8c", "name": "network-vif-plugged", "status": "completed", "tag": "6f4bdd7e-2b10-4789-8e67-555594e488b6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:07.075950 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-8c1219c9-2218-494d-ad43-c49d9fde30db req-a3a2dc80-a861-44ac-8cb7-39a232d9755b service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:07.076436 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-8c1219c9-2218-494d-ad43-c49d9fde30db req-a3a2dc80-a861-44ac-8cb7-39a232d9755b service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:07.092920 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-8c1219c9-2218-494d-ad43-c49d9fde30db req-a3a2dc80-a861-44ac-8cb7-39a232d9755b service nova] Creating event network-vif-plugged:6f4bdd7e-2b10-4789-8e67-555594e488b6 for instance a2880642-059e-4718-b9ed-becd8b1dad8c on hv-cinder-84517 Aug 01 14:16:07.101888 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-8c1219c9-2218-494d-ad43-c49d9fde30db req-a3a2dc80-a861-44ac-8cb7-39a232d9755b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042962 Aug 01 14:16:07.102684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 432/846] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:07.538417 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:07.539429 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:07.549408 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:07.550155 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:07.551378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:07.552059 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:07.706038 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:07.715810 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:07.718311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:07.723148 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ccb280fa-8ec2-4d2d-a21e-a1ed583d1ca0 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.185842 Aug 01 14:16:07.737328 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 415/847] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:07 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:08.746635 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:08.747315 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:08.754316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.754753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:08.755561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.755972 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:08.927236 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:08.937475 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:08.938859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:08.940073 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-77054dbe-a229-48a6-8066-75740375c3aa tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.198434 Aug 01 14:16:08.940697 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 433/848] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:08 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:09.969304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:09.970003 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:09.977446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:09.977888 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:09.978686 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:09.979121 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:10.126183 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:10.135971 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:10.137514 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:10.138897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d1e9b291-d3ff-4bbe-a8d4-79bed8024565 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.173649 Aug 01 14:16:10.139602 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 416/849] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:09 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:11.166195 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:11.166820 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:11.174042 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.174492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.175274 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.175686 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.329835 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:11.338441 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:11.339951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:11.341186 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-363b67b7-d0fa-4ccc-9ac3-1f018069d8d8 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.180943 Aug 01 14:16:11.341763 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 434/850] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:11 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:11.519402 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f48a72a0-be08-4296-919f-104e29e8890e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:11.520206 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f48a72a0-be08-4296-919f-104e29e8890e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:11.531867 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f48a72a0-be08-4296-919f-104e29e8890e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.532465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f48a72a0-be08-4296-919f-104e29e8890e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.533979 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f48a72a0-be08-4296-919f-104e29e8890e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.534540 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f48a72a0-be08-4296-919f-104e29e8890e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.562401 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f48a72a0-be08-4296-919f-104e29e8890e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/ips" status: 200 len: 148 microversion: 2.1 time: 0.047276 Aug 01 14:16:11.565671 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 417/851] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:16:11 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:12.365251 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:12.365901 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:12.373122 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:12.373573 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:12.374361 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:12.374799 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:12.541701 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:12.551998 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:12.553601 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:12.554881 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2a99827d-d691-46a3-b355-de0a565cf1e6 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1726 microversion: 2.20 time: 0.194504 Aug 01 14:16:12.555496 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 435/852] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:12 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1726 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:13.075282 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-88d23c23-cee0-4ef1-8aa1-eafbaa0d143d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fb4f9fc-a69e-4825-b6ed-654149712634"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:13.078036 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-88d23c23-cee0-4ef1-8aa1-eafbaa0d143d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:13.087089 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-88d23c23-cee0-4ef1-8aa1-eafbaa0d143d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:13.088010 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-88d23c23-cee0-4ef1-8aa1-eafbaa0d143d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:13.090302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-88d23c23-cee0-4ef1-8aa1-eafbaa0d143d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:13.090302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-88d23c23-cee0-4ef1-8aa1-eafbaa0d143d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:13.404481 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-88d23c23-cee0-4ef1-8aa1-eafbaa0d143d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333062 Aug 01 14:16:13.405414 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 418/853] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:16:13 2022] POST /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:13.578346 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:13.578966 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:13.598011 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:13.598562 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:13.599427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:13.599903 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:13.759943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:13.769226 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:13.770646 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:13.771821 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-53fc82d8-0046-4409-bc5e-2bda176d5ced tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1713 microversion: 2.20 time: 0.197724 Aug 01 14:16:13.772441 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 436/854] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:13 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1713 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:21.062400 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-46b1bddf-cd43-426a-b8f4-92c26aa59e1b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: .version_select at 0x7fc5795a8c10>, body: {"keypair": {"name": "tempest-keypair-2131438269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5uApq/nDo4EqpoKD6H0HLncoLOcsFVHDLWszQWYCIJgAqXL3OV/5gzjps2/jSpTbcUa3HVYIH7nJqRjsRpVrtfPXyJSFdtBgocKD/H6aa28/ajpb4FE2KEOdvX4B3v7A=="}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:21.088143 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-46b1bddf-cd43-426a-b8f4-92c26aa59e1b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for project db87d8b3358945aa88acbdc4246917ae. Resources: {'key_pairs'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:16:21.095964 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-46b1bddf-cd43-426a-b8f4-92c26aa59e1b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for user a9fc33bdca304c33b6a78122a54f492a and project db87d8b3358945aa88acbdc4246917ae. Resources: {'key_pairs'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:16:21.137536 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-46b1bddf-cd43-426a-b8f4-92c26aa59e1b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079285 Aug 01 14:16:21.138582 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 419/855] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:16:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:23.033145 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1731729446", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1987c22e-ab83-4108-bc22-29b9909b71a1"}], "security_groups": [{"name": "tempest-securitygroup--1535005503"}], "key_name": "tempest-keypair-2131438269", "user_data": "}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:23.201962 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] validate_networks() for [('1987c22e-ab83-4108-bc22-29b9909b71a1', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:16:23.691973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:16:23.692662 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:16:23.693288 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:16:23.693874 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:16:23.694567 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:16:23.705216 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:23.705658 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:23.706483 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:23.706910 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:23.729093 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for project db87d8b3358945aa88acbdc4246917ae. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:16:23.733605 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for user a9fc33bdca304c33b6a78122a54f492a and project db87d8b3358945aa88acbdc4246917ae. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:16:23.746880 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:16:23.749282 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:16:23.807726 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0d812921-ca5a-4d55-9cde-94905770dc1d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.783517 Aug 01 14:16:23.809374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 437/856] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:16:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:16:23.820487 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-06008f82-7f6b-4f8a-9480-f3f7fd297290 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:23.821300 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-06008f82-7f6b-4f8a-9480-f3f7fd297290 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:23.824230 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:23.895633 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-06008f82-7f6b-4f8a-9480-f3f7fd297290 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:23.907099 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-06008f82-7f6b-4f8a-9480-f3f7fd297290 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1242 microversion: 2.1 time: 0.090031 Aug 01 14:16:23.908463 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 420/857] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:23 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:24.938391 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a363668f-d01e-47a3-90e0-5eba522aef2f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:24.939519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a363668f-d01e-47a3-90e0-5eba522aef2f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:24.951057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a363668f-d01e-47a3-90e0-5eba522aef2f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:24.951816 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a363668f-d01e-47a3-90e0-5eba522aef2f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:24.953233 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a363668f-d01e-47a3-90e0-5eba522aef2f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:24.954177 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a363668f-d01e-47a3-90e0-5eba522aef2f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:25.068831 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a363668f-d01e-47a3-90e0-5eba522aef2f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:25.085235 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a363668f-d01e-47a3-90e0-5eba522aef2f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1294 microversion: 2.1 time: 0.154988 Aug 01 14:16:25.088314 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 438/858] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:24 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1294 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:26.107969 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-58a9dde1-2a54-45e7-82b7-7ffc00254b0c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:26.108631 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-58a9dde1-2a54-45e7-82b7-7ffc00254b0c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:26.119018 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-58a9dde1-2a54-45e7-82b7-7ffc00254b0c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.119475 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-58a9dde1-2a54-45e7-82b7-7ffc00254b0c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.120354 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-58a9dde1-2a54-45e7-82b7-7ffc00254b0c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.121396 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-58a9dde1-2a54-45e7-82b7-7ffc00254b0c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.386048 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-58a9dde1-2a54-45e7-82b7-7ffc00254b0c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:26.394424 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-58a9dde1-2a54-45e7-82b7-7ffc00254b0c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1368 microversion: 2.1 time: 0.290839 Aug 01 14:16:26.417705 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 421/859] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:26 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:26.928837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-0eef94ea-7ad8-4e46-95cd-a91256265a63 req-f8aec92c-5088-4f68-9839-e747f4351be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9704aec6-fe5a-451d-9716-53653d6d48f2", "tag": "f177eb18-8063-423f-b76e-febb47f8d425"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:26.940894 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-0eef94ea-7ad8-4e46-95cd-a91256265a63 req-f8aec92c-5088-4f68-9839-e747f4351be7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.941332 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-0eef94ea-7ad8-4e46-95cd-a91256265a63 req-f8aec92c-5088-4f68-9839-e747f4351be7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.953984 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-0eef94ea-7ad8-4e46-95cd-a91256265a63 req-f8aec92c-5088-4f68-9839-e747f4351be7 service nova] Creating event network-changed:f177eb18-8063-423f-b76e-febb47f8d425 for instance 9704aec6-fe5a-451d-9716-53653d6d48f2 on hv-cinder-84517 Aug 01 14:16:26.959528 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-0eef94ea-7ad8-4e46-95cd-a91256265a63 req-f8aec92c-5088-4f68-9839-e747f4351be7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034590 Aug 01 14:16:26.960417 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 439/860] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:27.419821 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4685e639-e91a-47e6-bead-43b93b507d7b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:27.420709 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4685e639-e91a-47e6-bead-43b93b507d7b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:27.431387 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4685e639-e91a-47e6-bead-43b93b507d7b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:27.431977 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4685e639-e91a-47e6-bead-43b93b507d7b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:27.433000 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4685e639-e91a-47e6-bead-43b93b507d7b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:27.433569 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4685e639-e91a-47e6-bead-43b93b507d7b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:27.593376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4685e639-e91a-47e6-bead-43b93b507d7b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:27.601993 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4685e639-e91a-47e6-bead-43b93b507d7b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1368 microversion: 2.1 time: 0.187589 Aug 01 14:16:27.602668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 422/861] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:27 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:28.625119 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-de17cfe8-6fc6-4772-b236-e7e7a078c526 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:28.626415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-de17cfe8-6fc6-4772-b236-e7e7a078c526 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:28.633605 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de17cfe8-6fc6-4772-b236-e7e7a078c526 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:28.634199 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de17cfe8-6fc6-4772-b236-e7e7a078c526 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:28.635112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de17cfe8-6fc6-4772-b236-e7e7a078c526 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:28.635648 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de17cfe8-6fc6-4772-b236-e7e7a078c526 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:28.826874 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-de17cfe8-6fc6-4772-b236-e7e7a078c526 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:28.838233 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-de17cfe8-6fc6-4772-b236-e7e7a078c526 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1368 microversion: 2.1 time: 0.218412 Aug 01 14:16:28.838818 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 440/862] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:28 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:29.858971 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bafe6a77-ac2f-4f1c-83d5-b62233360b66 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:29.859787 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bafe6a77-ac2f-4f1c-83d5-b62233360b66 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:29.867380 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bafe6a77-ac2f-4f1c-83d5-b62233360b66 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:29.867894 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bafe6a77-ac2f-4f1c-83d5-b62233360b66 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:29.868776 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bafe6a77-ac2f-4f1c-83d5-b62233360b66 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:29.869269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bafe6a77-ac2f-4f1c-83d5-b62233360b66 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:30.026090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-bafe6a77-ac2f-4f1c-83d5-b62233360b66 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:30.033996 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bafe6a77-ac2f-4f1c-83d5-b62233360b66 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1368 microversion: 2.1 time: 0.179416 Aug 01 14:16:30.034910 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 423/863] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:29 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:31.059481 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-051bfa55-1c72-46a1-941d-b57e6a444e08 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:31.073145 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-051bfa55-1c72-46a1-941d-b57e6a444e08 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:31.076311 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:31.087539 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-051bfa55-1c72-46a1-941d-b57e6a444e08 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:31.088022 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-051bfa55-1c72-46a1-941d-b57e6a444e08 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:31.088918 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-051bfa55-1c72-46a1-941d-b57e6a444e08 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:31.089361 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-051bfa55-1c72-46a1-941d-b57e6a444e08 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:31.365689 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-758eea10-de4c-49d2-8e12-d9a975811012 req-ac625942-bb00-4e8c-b54e-0d0a336e7d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9704aec6-fe5a-451d-9716-53653d6d48f2", "name": "network-vif-plugged", "status": "completed", "tag": "f177eb18-8063-423f-b76e-febb47f8d425"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:31.385831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-758eea10-de4c-49d2-8e12-d9a975811012 req-ac625942-bb00-4e8c-b54e-0d0a336e7d2f service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:31.386790 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-758eea10-de4c-49d2-8e12-d9a975811012 req-ac625942-bb00-4e8c-b54e-0d0a336e7d2f service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:31.410834 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-758eea10-de4c-49d2-8e12-d9a975811012 req-ac625942-bb00-4e8c-b54e-0d0a336e7d2f service nova] Creating event network-vif-plugged:f177eb18-8063-423f-b76e-febb47f8d425 for instance 9704aec6-fe5a-451d-9716-53653d6d48f2 on hv-cinder-84517 Aug 01 14:16:31.420845 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-758eea10-de4c-49d2-8e12-d9a975811012 req-ac625942-bb00-4e8c-b54e-0d0a336e7d2f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061178 Aug 01 14:16:31.422779 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 424/864] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:31.579132 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-051bfa55-1c72-46a1-941d-b57e6a444e08 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:31.592513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-051bfa55-1c72-46a1-941d-b57e6a444e08 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1368 microversion: 2.1 time: 0.540367 Aug 01 14:16:31.594567 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 441/865] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:31 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1368 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:32.628868 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-68612af7-e223-4896-9227-3a19cf6331d4 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:32.629576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-68612af7-e223-4896-9227-3a19cf6331d4 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:32.631668 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:32.637588 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-68612af7-e223-4896-9227-3a19cf6331d4 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:32.638039 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-68612af7-e223-4896-9227-3a19cf6331d4 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:32.638830 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-68612af7-e223-4896-9227-3a19cf6331d4 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:32.639261 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-68612af7-e223-4896-9227-3a19cf6331d4 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:32.795925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-68612af7-e223-4896-9227-3a19cf6331d4 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:32.803880 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-68612af7-e223-4896-9227-3a19cf6331d4 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1368 microversion: 2.1 time: 0.179983 Aug 01 14:16:32.804373 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 425/866] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:32 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:33.824959 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1c6f4be6-5a03-4f6b-a12f-376d343a50fd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:33.825559 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1c6f4be6-5a03-4f6b-a12f-376d343a50fd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:33.827930 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:33.828878 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:33.835548 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1c6f4be6-5a03-4f6b-a12f-376d343a50fd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:33.835994 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1c6f4be6-5a03-4f6b-a12f-376d343a50fd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:33.836855 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1c6f4be6-5a03-4f6b-a12f-376d343a50fd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:33.837290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1c6f4be6-5a03-4f6b-a12f-376d343a50fd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:33.840135 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=59 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:33.972636 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1c6f4be6-5a03-4f6b-a12f-376d343a50fd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:33.980432 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1c6f4be6-5a03-4f6b-a12f-376d343a50fd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1558 microversion: 2.1 time: 0.159476 Aug 01 14:16:33.980990 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 442/867] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:33 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:34.001110 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-02cb538a-4aff-4aaa-bf04-69973d7e6f78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:34.001856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-02cb538a-4aff-4aaa-bf04-69973d7e6f78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:34.004076 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=6 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:34.010090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-02cb538a-4aff-4aaa-bf04-69973d7e6f78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:34.010535 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-02cb538a-4aff-4aaa-bf04-69973d7e6f78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:34.011311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-02cb538a-4aff-4aaa-bf04-69973d7e6f78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:34.011740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-02cb538a-4aff-4aaa-bf04-69973d7e6f78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:34.102119 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-02cb538a-4aff-4aaa-bf04-69973d7e6f78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104646 Aug 01 14:16:34.102768 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 426/868] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 14:16:33 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:35.204627 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-71dce2e0-1925-4b80-8479-ab8d40bbc96d req-f8671c4d-0dfc-4f35-b78b-545faf8c6803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9704aec6-fe5a-451d-9716-53653d6d48f2", "tag": "f177eb18-8063-423f-b76e-febb47f8d425"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:35.215538 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-71dce2e0-1925-4b80-8479-ab8d40bbc96d req-f8671c4d-0dfc-4f35-b78b-545faf8c6803 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:35.216092 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-71dce2e0-1925-4b80-8479-ab8d40bbc96d req-f8671c4d-0dfc-4f35-b78b-545faf8c6803 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:35.232565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-71dce2e0-1925-4b80-8479-ab8d40bbc96d req-f8671c4d-0dfc-4f35-b78b-545faf8c6803 service nova] Creating event network-changed:f177eb18-8063-423f-b76e-febb47f8d425 for instance 9704aec6-fe5a-451d-9716-53653d6d48f2 on hv-cinder-84517 Aug 01 14:16:35.240517 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-71dce2e0-1925-4b80-8479-ab8d40bbc96d req-f8671c4d-0dfc-4f35-b78b-545faf8c6803 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040449 Aug 01 14:16:35.241569 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 443/869] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:46.836680 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:46.837512 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=30 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:46.842193 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a2a5dbaa-3996-416a-b0b4-5c89d7014457 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:46.852378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a2a5dbaa-3996-416a-b0b4-5c89d7014457 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:46.852378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2a5dbaa-3996-416a-b0b4-5c89d7014457 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.852378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2a5dbaa-3996-416a-b0b4-5c89d7014457 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.853100 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2a5dbaa-3996-416a-b0b4-5c89d7014457 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.853527 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a2a5dbaa-3996-416a-b0b4-5c89d7014457 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.884846 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a2a5dbaa-3996-416a-b0b4-5c89d7014457 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049474 Aug 01 14:16:46.885466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 427/870] 10.222.0.45 () {60 vars in 1343 bytes} [Mon Aug 1 14:16:46 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:46.954878 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=5 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:46.955646 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=7 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:46.960371 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e8ea0935-9352-4baf-be95-ee8b8717c23a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:46.960994 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e8ea0935-9352-4baf-be95-ee8b8717c23a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:46.968761 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e8ea0935-9352-4baf-be95-ee8b8717c23a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.969371 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e8ea0935-9352-4baf-be95-ee8b8717c23a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.970266 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e8ea0935-9352-4baf-be95-ee8b8717c23a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.970832 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e8ea0935-9352-4baf-be95-ee8b8717c23a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:47.000323 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e8ea0935-9352-4baf-be95-ee8b8717c23a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:16:47.087159 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e8ea0935-9352-4baf-be95-ee8b8717c23a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 204 len: 0 microversion: 2.20 time: 0.133463 Aug 01 14:16:47.087615 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 444/871] 10.222.0.45 () {60 vars in 1280 bytes} [Mon Aug 1 14:16:46 2022] DELETE /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:16:47.096732 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:47.097423 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:47.103836 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:47.104306 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:47.105103 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:47.105544 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:47.264649 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:47.273534 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:47.275070 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:47.276252 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-823705c4-4cad-4b44-8777-b697e332b518 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.183746 Aug 01 14:16:47.276854 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 428/872] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:47 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:48.302853 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:48.303743 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:48.310840 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:48.311279 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:48.312054 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:48.312518 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:48.484021 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:48.493605 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:48.495285 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:48.496751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4a771784-b1ac-4e98-b498-a13d4e92fd5a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1719 microversion: 2.20 time: 0.198297 Aug 01 14:16:48.497484 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 445/873] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:48 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:49.524603 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:49.525402 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:49.535294 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:49.536133 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:49.539820 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:49.541585 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:49.550507 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-c7850207-e680-4f32-9e36-ddf0501ba5c6 req-c55f6f71-0cbc-4c45-81fb-3f3779bee4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2880642-059e-4718-b9ed-becd8b1dad8c", "name": "network-vif-deleted", "tag": "6f4bdd7e-2b10-4789-8e67-555594e488b6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:49.574191 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c7850207-e680-4f32-9e36-ddf0501ba5c6 req-c55f6f71-0cbc-4c45-81fb-3f3779bee4d7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:49.574650 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c7850207-e680-4f32-9e36-ddf0501ba5c6 req-c55f6f71-0cbc-4c45-81fb-3f3779bee4d7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:49.590160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-c7850207-e680-4f32-9e36-ddf0501ba5c6 req-c55f6f71-0cbc-4c45-81fb-3f3779bee4d7 service nova] Creating event network-vif-deleted:6f4bdd7e-2b10-4789-8e67-555594e488b6 for instance a2880642-059e-4718-b9ed-becd8b1dad8c on hv-cinder-84517 Aug 01 14:16:49.596591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-c7850207-e680-4f32-9e36-ddf0501ba5c6 req-c55f6f71-0cbc-4c45-81fb-3f3779bee4d7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049590 Aug 01 14:16:49.597097 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 446/874] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:49.626517 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:49.637963 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:49.639976 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '403896b926a1445b9895dc2d8d21854f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86a28aa09db413593b6047d4cbd0559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:49.641625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b9842ac4-10de-4245-861e-72b8bda2cf51 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 200 len: 1653 microversion: 2.20 time: 0.122270 Aug 01 14:16:49.652359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 429/875] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:49 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 1653 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:50.675334 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:50.676110 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:50.683410 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:50.683886 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:50.684705 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:50.685139 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:50.702159 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] HTTP exception thrown: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Request method failure captured: Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c HTTP/1.1 Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi597El6IZaJp30kBgZIIWotHVfYK5X0V0t7lE7acoVFaLM4W1P6-l2UQFUyBpH11BmZ3wTYD860Lgqboy80r4mAFDW2pRd-9vEvfSY0--uV8TwbTsdQ5rE_XyME9cbGTrKkFmgtC71CCKrpxC31Pyy-GEK4EuFrgIR9zM4fM85MBEo38 Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:16:50.703870 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86a28aa09db413593b6047d4cbd0559", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86a28aa09db413593b6047d4cbd0559"}]}] Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 403896b926a1445b9895dc2d8d21854f Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:50.705638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': 'a2880642-059e-4718-b9ed-becd8b1dad8c'} Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:50.706519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:50.707908 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:50.709756 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Returning 404 to user: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:50.709756 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d4bd23c4-add0-44d2-bf62-74a553fe412b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 404 len: 111 microversion: 2.20 time: 0.035142 Aug 01 14:16:50.709756 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 447/876] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:50 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:16:50.716066 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-329c0f8f-101f-4a41-9201-2151e55a3680 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '.version_select at 0x7fc579674a60>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:50.738828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-329c0f8f-101f-4a41-9201-2151e55a3680 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-153954601" status: 204 len: 0 microversion: 2.20 time: 0.027530 Aug 01 14:16:50.739431 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 430/877] 10.222.0.45 () {60 vars in 1259 bytes} [Mon Aug 1 14:16:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-153954601 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 14:16:52.738324 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:52.738941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:52.745963 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:52.746384 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:52.747165 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:52.747577 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:52.763204 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] HTTP exception thrown: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Request method failure captured: Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c HTTP/1.1 Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi597El6IZaJp30kBgZIIWotHVfYK5X0V0t7lE7acoVFaLM4W1P6-l2UQFUyBpH11BmZ3wTYD860Lgqboy80r4mAFDW2pRd-9vEvfSY0--uV8TwbTsdQ5rE_XyME9cbGTrKkFmgtC71CCKrpxC31Pyy-GEK4EuFrgIR9zM4fM85MBEo38 Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:16:52.764978 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86a28aa09db413593b6047d4cbd0559", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86a28aa09db413593b6047d4cbd0559"}]}] Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 403896b926a1445b9895dc2d8d21854f Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.766736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': 'a2880642-059e-4718-b9ed-becd8b1dad8c'} Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:52.767684 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.769112 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.770491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Returning 404 to user: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:52.770491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d9c760b1-23ca-4c0e-8abf-48e66b5a9ca3 tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 404 len: 111 microversion: 2.20 time: 0.032214 Aug 01 14:16:52.770491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 448/878] 10.222.0.45 () {60 vars in 1280 bytes} [Mon Aug 1 14:16:52 2022] DELETE /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:16:52.776610 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:52.777589 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: a2880642-059e-4718-b9ed-becd8b1dad8c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:52.783929 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:52.784398 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:52.785177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:52.785614 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:52.803041 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] HTTP exception thrown: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Request method failure captured: Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c HTTP/1.1 Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi597El6IZaJp30kBgZIIWotHVfYK5X0V0t7lE7acoVFaLM4W1P6-l2UQFUyBpH11BmZ3wTYD860Lgqboy80r4mAFDW2pRd-9vEvfSY0--uV8TwbTsdQ5rE_XyME9cbGTrKkFmgtC71CCKrpxC31Pyy-GEK4EuFrgIR9zM4fM85MBEo38 Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:16:52.805020 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86a28aa09db413593b6047d4cbd0559", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86a28aa09db413593b6047d4cbd0559"}]}] Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 403896b926a1445b9895dc2d8d21854f Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.807047 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': 'a2880642-059e-4718-b9ed-becd8b1dad8c'} Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:52.807828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. Aug 01 14:16:52.809613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:52.811029 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Returning 404 to user: Instance a2880642-059e-4718-b9ed-becd8b1dad8c could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:52.811029 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-32827319-6160-43c4-af30-dda9fd890b1c tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c" status: 404 len: 111 microversion: 2.20 time: 0.034767 Aug 01 14:16:52.811029 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 431/879] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:52 2022] GET /compute/v2.1/servers/a2880642-059e-4718-b9ed-becd8b1dad8c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:16:53.972225 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:53.973386 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:53.982555 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:53.983329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:53.984809 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:53.985579 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.011119 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] HTTP exception thrown: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Request method failure captured: Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 HTTP/1.1 Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi597El6IZaJp30kBgZIIWotHVfYK5X0V0t7lE7acoVFaLM4W1P6-l2UQFUyBpH11BmZ3wTYD860Lgqboy80r4mAFDW2pRd-9vEvfSY0--uV8TwbTsdQ5rE_XyME9cbGTrKkFmgtC71CCKrpxC31Pyy-GEK4EuFrgIR9zM4fM85MBEo38 Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:16:54.014102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86a28aa09db413593b6047d4cbd0559", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86a28aa09db413593b6047d4cbd0559"}]}] Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 403896b926a1445b9895dc2d8d21854f Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.015753 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '446cfa38-0982-47b2-8e3f-a44a35257447'} Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:54.016770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.018333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.019715 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Returning 404 to user: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:54.019715 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6af5c874-6085-4775-8a9a-c36bfa22d06a tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "DELETE /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 404 len: 111 microversion: 2.20 time: 0.048061 Aug 01 14:16:54.019715 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 449/880] 10.222.0.45 () {60 vars in 1280 bytes} [Mon Aug 1 14:16:53 2022] DELETE /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:16:54.027930 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:54.028621 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] [instance: 446cfa38-0982-47b2-8e3f-a44a35257447] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:54.035583 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:54.036027 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.037269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:54.037664 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.052871 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] HTTP exception thrown: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Request method failure captured: Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 HTTP/1.1 Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi597El6IZaJp30kBgZIIWotHVfYK5X0V0t7lE7acoVFaLM4W1P6-l2UQFUyBpH11BmZ3wTYD860Lgqboy80r4mAFDW2pRd-9vEvfSY0--uV8TwbTsdQ5rE_XyME9cbGTrKkFmgtC71CCKrpxC31Pyy-GEK4EuFrgIR9zM4fM85MBEo38 Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:16:54.054580 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86a28aa09db413593b6047d4cbd0559", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86a28aa09db413593b6047d4cbd0559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86a28aa09db413593b6047d4cbd0559"}]}] Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: c86a28aa09db413593b6047d4cbd0559 Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1459521597 Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 403896b926a1445b9895dc2d8d21854f Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1459521597-project Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.056291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '446cfa38-0982-47b2-8e3f-a44a35257447'} Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:54.057298 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. Aug 01 14:16:54.058807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:16:54.060165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] Returning 404 to user: Instance 446cfa38-0982-47b2-8e3f-a44a35257447 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:54.060165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-701105f2-6315-40bb-b5c2-511999a1162b tempest-AttachVolumeShelveTestJSON-1459521597 tempest-AttachVolumeShelveTestJSON-1459521597-project] 10.222.0.45 "GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447" status: 404 len: 111 microversion: 2.20 time: 0.032135 Aug 01 14:16:54.060165 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 432/881] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:54 2022] GET /compute/v2.1/servers/446cfa38-0982-47b2-8e3f-a44a35257447 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:16:59.354451 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e279d59f-bb3b-4fa7-a16d-3cb99d314bed tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:59.355000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e279d59f-bb3b-4fa7-a16d-3cb99d314bed tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:59.356834 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-a700414f-8055-45d4-b8b4-ce86f59b9c61 req-0bd9a145-30e6-4e15-a9f8-ed7e2d35ea2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38da3c04-7cad-47ab-b253-e133bdeb480c", "tag": "ec79e886-ddb7-4769-af78-cfcf4186343e"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:59.362673 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e279d59f-bb3b-4fa7-a16d-3cb99d314bed tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:59.363729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e279d59f-bb3b-4fa7-a16d-3cb99d314bed tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:59.364957 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e279d59f-bb3b-4fa7-a16d-3cb99d314bed tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:59.366097 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e279d59f-bb3b-4fa7-a16d-3cb99d314bed tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:59.367354 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-a700414f-8055-45d4-b8b4-ce86f59b9c61 req-0bd9a145-30e6-4e15-a9f8-ed7e2d35ea2e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:59.367789 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-a700414f-8055-45d4-b8b4-ce86f59b9c61 req-0bd9a145-30e6-4e15-a9f8-ed7e2d35ea2e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:59.384138 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-a700414f-8055-45d4-b8b4-ce86f59b9c61 req-0bd9a145-30e6-4e15-a9f8-ed7e2d35ea2e service nova] Creating event network-changed:ec79e886-ddb7-4769-af78-cfcf4186343e for instance 38da3c04-7cad-47ab-b253-e133bdeb480c on hv-cinder-84517 Aug 01 14:16:59.393011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-a700414f-8055-45d4-b8b4-ce86f59b9c61 req-0bd9a145-30e6-4e15-a9f8-ed7e2d35ea2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039319 Aug 01 14:16:59.394306 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 433/882] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:59.397182 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e279d59f-bb3b-4fa7-a16d-3cb99d314bed tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:16:59.518593 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e279d59f-bb3b-4fa7-a16d-3cb99d314bed tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "DELETE /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 204 len: 0 microversion: 2.1 time: 0.167533 Aug 01 14:16:59.523256 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 450/883] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:16:59 2022] DELETE /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:16:59.529193 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c3b2925d-3205-444a-98e2-12433ec0bc61 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:59.529889 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c3b2925d-3205-444a-98e2-12433ec0bc61 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:59.548869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c3b2925d-3205-444a-98e2-12433ec0bc61 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:59.549666 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c3b2925d-3205-444a-98e2-12433ec0bc61 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:59.550075 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c3b2925d-3205-444a-98e2-12433ec0bc61 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:59.550501 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c3b2925d-3205-444a-98e2-12433ec0bc61 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:00.026456 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-c3b2925d-3205-444a-98e2-12433ec0bc61 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:00.042726 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c3b2925d-3205-444a-98e2-12433ec0bc61 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.517270 Aug 01 14:17:00.043840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 434/884] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:59 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:17:01.078859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c04b52a2-922d-4942-a7e3-3a9735657b71 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:01.080168 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c04b52a2-922d-4942-a7e3-3a9735657b71 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:01.087486 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c04b52a2-922d-4942-a7e3-3a9735657b71 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:01.087935 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c04b52a2-922d-4942-a7e3-3a9735657b71 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:01.088739 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c04b52a2-922d-4942-a7e3-3a9735657b71 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:01.089174 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c04b52a2-922d-4942-a7e3-3a9735657b71 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:01.471798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c04b52a2-922d-4942-a7e3-3a9735657b71 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:01.480008 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c04b52a2-922d-4942-a7e3-3a9735657b71 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1567 microversion: 2.1 time: 0.405303 Aug 01 14:17:01.480644 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 451/885] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:01 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1567 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:01.989288 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-baf9a21d-473d-4411-bcf8-02180526148a req-36bf7ad0-78e0-4ba8-92a2-1bcea1d5bb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38da3c04-7cad-47ab-b253-e133bdeb480c", "name": "network-vif-deleted", "tag": "ec79e886-ddb7-4769-af78-cfcf4186343e"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:02.003149 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-baf9a21d-473d-4411-bcf8-02180526148a req-36bf7ad0-78e0-4ba8-92a2-1bcea1d5bb2e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:02.003149 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-baf9a21d-473d-4411-bcf8-02180526148a req-36bf7ad0-78e0-4ba8-92a2-1bcea1d5bb2e service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:02.016416 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-baf9a21d-473d-4411-bcf8-02180526148a req-36bf7ad0-78e0-4ba8-92a2-1bcea1d5bb2e service nova] Creating event network-vif-deleted:ec79e886-ddb7-4769-af78-cfcf4186343e for instance 38da3c04-7cad-47ab-b253-e133bdeb480c on hv-cinder-84517 Aug 01 14:17:02.022718 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-baf9a21d-473d-4411-bcf8-02180526148a req-36bf7ad0-78e0-4ba8-92a2-1bcea1d5bb2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036766 Aug 01 14:17:02.023466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 435/886] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:02.502858 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:02.503480 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:02.510849 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:02.511483 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:02.512222 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:02.512828 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:02.567703 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:02.568468 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:02.569161 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lazy-loading 'fault' on Instance uuid 38da3c04-7cad-47ab-b253-e133bdeb480c {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:17:02.623550 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ae8decd5354231bebc7bfda44d3285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfbca571c4b4199a577322e866dfae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:02.631764 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cbf21594-d227-408b-96f0-72739e797fc1 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 200 len: 1224 microversion: 2.1 time: 0.133227 Aug 01 14:17:02.632392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 452/887] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:02 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 1224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:03.654137 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:03.655074 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] [instance: 38da3c04-7cad-47ab-b253-e133bdeb480c] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:03.662936 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:03.663383 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:03.664158 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:03.664652 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:03.680552 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] HTTP exception thrown: Instance 38da3c04-7cad-47ab-b253-e133bdeb480c could not be found. Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Request method failure captured: Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c HTTP/1.1 Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi597kMjzy7TxVx-kyLE3LRKbkKQrLRb2GnCqQKDBCiGZ6ljS6-vsyiAiZc8-jlXnt4k4yWW81ggcrjsfmKZHKVB1mbFtCOZYBKOga_AjXf1lky1Qzn_zk20uY6TFDoxCsQK5od49I3JNXvzMmDsOtyEyJk_IJdYzk4Rbdu788LgFrC6Y Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 6bfbca571c4b4199a577322e866dfae9 Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-TestShelveInstance-2064287483 Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:17:03.682372 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6bfbca571c4b4199a577322e866dfae9", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6bfbca571c4b4199a577322e866dfae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6bfbca571c4b4199a577322e866dfae9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6bfbca571c4b4199a577322e866dfae9"}]}] Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-TestShelveInstance-2064287483 Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 6bfbca571c4b4199a577322e866dfae9 Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-TestShelveInstance-2064287483 Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-TestShelveInstance-2064287483-project Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: b4ae8decd5354231bebc7bfda44d3285 Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-TestShelveInstance-2064287483-project Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 38da3c04-7cad-47ab-b253-e133bdeb480c could not be found. Aug 01 14:17:03.684728 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '38da3c04-7cad-47ab-b253-e133bdeb480c'} Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38da3c04-7cad-47ab-b253-e133bdeb480c could not be found. Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:03.685809 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38da3c04-7cad-47ab-b253-e133bdeb480c could not be found. Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38da3c04-7cad-47ab-b253-e133bdeb480c could not be found. Aug 01 14:17:03.687363 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:03.688865 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Returning 404 to user: Instance 38da3c04-7cad-47ab-b253-e133bdeb480c could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:03.688865 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2ae7ef66-36e5-403a-bd98-77a79d368f09 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c" status: 404 len: 111 microversion: 2.1 time: 0.034097 Aug 01 14:17:03.688865 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 436/888] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:03 2022] GET /compute/v2.1/servers/38da3c04-7cad-47ab-b253-e133bdeb480c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:17:03.864040 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-097e384f-cf2e-4681-a626-35b85b66cb24 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] Calling method '.version_select at 0x7fc5796b4a60>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:03.886595 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-097e384f-cf2e-4681-a626-35b85b66cb24 tempest-TestShelveInstance-2064287483 tempest-TestShelveInstance-2064287483-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-875785955" status: 202 len: 0 microversion: 2.1 time: 0.026520 Aug 01 14:17:03.890664 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 453/889] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-875785955 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:17:11.454883 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ac480128-19a4-4295-a2fc-b633393ce62c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:11.455763 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ac480128-19a4-4295-a2fc-b633393ce62c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:11.471519 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac480128-19a4-4295-a2fc-b633393ce62c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:11.472339 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac480128-19a4-4295-a2fc-b633393ce62c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:11.473745 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac480128-19a4-4295-a2fc-b633393ce62c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:11.474587 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ac480128-19a4-4295-a2fc-b633393ce62c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:11.516880 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ac480128-19a4-4295-a2fc-b633393ce62c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2/ips" status: 200 len: 150 microversion: 2.1 time: 0.070560 Aug 01 14:17:11.517504 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 437/890] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:17:11 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2/ips => generated 150 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:11.530593 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fb4f9fc-a69e-4825-b6ed-654149712634"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:11.533151 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:11.549429 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:11.550209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:11.551100 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:11.551598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:11.650600 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Invalid volume: volume 9fb4f9fc-a69e-4825-b6ed-654149712634 is already attached to instances: 730a6765-52cd-4528-9957-3165769c0820 Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: POST /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2/os-volume_attachments HTTP/1.1 Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 74 Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:17:11.654210 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {"volumeAttachment": {"volumeId": "9fb4f9fc-a69e-4825-b6ed-654149712634"}} Aug 01 14:17:11.655864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Invalid volume: volume 9fb4f9fc-a69e-4825-b6ed-654149712634 is already attached to instances: 730a6765-52cd-4528-9957-3165769c0820 Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'server_id': '9704aec6-fe5a-451d-9716-53653d6d48f2', 'body': {'volumeAttachment': {'volumeId': '9fb4f9fc-a69e-4825-b6ed-654149712634'}}} Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9fb4f9fc-a69e-4825-b6ed-654149712634 is already attached to instances: 730a6765-52cd-4528-9957-3165769c0820 Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:17:11.657000 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9fb4f9fc-a69e-4825-b6ed-654149712634 is already attached to instances: 730a6765-52cd-4528-9957-3165769c0820 Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:11.658495 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:11.659943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:11.659943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:11.659943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:11.659943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9fb4f9fc-a69e-4825-b6ed-654149712634 is already attached to instances: 730a6765-52cd-4528-9957-3165769c0820 Aug 01 14:17:11.659943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:17:11.663107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 400 to user: Invalid volume: volume 9fb4f9fc-a69e-4825-b6ed-654149712634 is already attached to instances: 730a6765-52cd-4528-9957-3165769c0820 {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:11.664802 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d2faf744-55c3-4a56-9863-09c610df7f13 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.138721 Aug 01 14:17:11.668944 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 454/891] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:17:11 2022] POST /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:17:11.681613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-89ddb56d-3209-4c85-a01f-3d97cc1e8011 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:11.683140 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-89ddb56d-3209-4c85-a01f-3d97cc1e8011 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:11.693876 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-89ddb56d-3209-4c85-a01f-3d97cc1e8011 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:11.694599 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-89ddb56d-3209-4c85-a01f-3d97cc1e8011 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:11.695735 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-89ddb56d-3209-4c85-a01f-3d97cc1e8011 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:11.696489 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-89ddb56d-3209-4c85-a01f-3d97cc1e8011 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:11.745763 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-89ddb56d-3209-4c85-a01f-3d97cc1e8011 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:17:11.866667 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-89ddb56d-3209-4c85-a01f-3d97cc1e8011 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 204 len: 0 microversion: 2.1 time: 0.192240 Aug 01 14:17:11.868633 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 438/892] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:17:11 2022] DELETE /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:17:11.886696 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a8c6bde6-eb01-4042-ab0a-79819fbf2a61 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:11.887471 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a8c6bde6-eb01-4042-ab0a-79819fbf2a61 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:11.903126 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a8c6bde6-eb01-4042-ab0a-79819fbf2a61 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:11.904985 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a8c6bde6-eb01-4042-ab0a-79819fbf2a61 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:11.906054 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a8c6bde6-eb01-4042-ab0a-79819fbf2a61 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:11.907054 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a8c6bde6-eb01-4042-ab0a-79819fbf2a61 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:12.156727 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a8c6bde6-eb01-4042-ab0a-79819fbf2a61 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:12.185010 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a8c6bde6-eb01-4042-ab0a-79819fbf2a61 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1683 microversion: 2.1 time: 0.308454 Aug 01 14:17:12.187804 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 455/893] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:11 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1683 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:13.212922 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-e8bfb7e2-0a7d-498d-99cb-a10e66e1fde6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:13.213669 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-e8bfb7e2-0a7d-498d-99cb-a10e66e1fde6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:13.223670 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e8bfb7e2-0a7d-498d-99cb-a10e66e1fde6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:13.224229 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e8bfb7e2-0a7d-498d-99cb-a10e66e1fde6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:13.225199 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e8bfb7e2-0a7d-498d-99cb-a10e66e1fde6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:13.225639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-e8bfb7e2-0a7d-498d-99cb-a10e66e1fde6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:13.400389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-e8bfb7e2-0a7d-498d-99cb-a10e66e1fde6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:13.415491 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-e8bfb7e2-0a7d-498d-99cb-a10e66e1fde6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1683 microversion: 2.1 time: 0.210706 Aug 01 14:17:13.428496 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 439/894] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:13 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1683 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:14.443417 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eae4fb34-ff70-40c9-ae23-02cba1cc6e60 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:14.444054 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eae4fb34-ff70-40c9-ae23-02cba1cc6e60 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:14.453305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eae4fb34-ff70-40c9-ae23-02cba1cc6e60 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:14.453305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eae4fb34-ff70-40c9-ae23-02cba1cc6e60 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:14.453305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eae4fb34-ff70-40c9-ae23-02cba1cc6e60 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:14.453720 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eae4fb34-ff70-40c9-ae23-02cba1cc6e60 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:14.630552 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eae4fb34-ff70-40c9-ae23-02cba1cc6e60 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:14.642652 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eae4fb34-ff70-40c9-ae23-02cba1cc6e60 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1683 microversion: 2.1 time: 0.203198 Aug 01 14:17:14.643240 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 456/895] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:14 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1683 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:15.671594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-082a7c85-5b0d-4fd2-8119-b3b7f88c95d8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:15.672635 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-082a7c85-5b0d-4fd2-8119-b3b7f88c95d8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:15.681435 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-082a7c85-5b0d-4fd2-8119-b3b7f88c95d8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:15.681907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-082a7c85-5b0d-4fd2-8119-b3b7f88c95d8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:15.682935 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-082a7c85-5b0d-4fd2-8119-b3b7f88c95d8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:15.683449 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-082a7c85-5b0d-4fd2-8119-b3b7f88c95d8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:15.822995 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-082a7c85-5b0d-4fd2-8119-b3b7f88c95d8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:15.831902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-082a7c85-5b0d-4fd2-8119-b3b7f88c95d8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 200 len: 1615 microversion: 2.1 time: 0.165608 Aug 01 14:17:15.832587 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 440/896] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:15 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 1615 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:16.147356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-7ebfa628-3862-415a-bfe4-c7c46e8ddfb5 req-65befc98-742a-4edd-a614-1009d60db0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9704aec6-fe5a-451d-9716-53653d6d48f2", "name": "network-vif-deleted", "tag": "f177eb18-8063-423f-b76e-febb47f8d425"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:16.165256 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-7ebfa628-3862-415a-bfe4-c7c46e8ddfb5 req-65befc98-742a-4edd-a614-1009d60db0a7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:16.165963 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-7ebfa628-3862-415a-bfe4-c7c46e8ddfb5 req-65befc98-742a-4edd-a614-1009d60db0a7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:16.179073 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-7ebfa628-3862-415a-bfe4-c7c46e8ddfb5 req-65befc98-742a-4edd-a614-1009d60db0a7 service nova] Creating event network-vif-deleted:f177eb18-8063-423f-b76e-febb47f8d425 for instance 9704aec6-fe5a-451d-9716-53653d6d48f2 on hv-cinder-84517 Aug 01 14:17:16.184734 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-7ebfa628-3862-415a-bfe4-c7c46e8ddfb5 req-65befc98-742a-4edd-a614-1009d60db0a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042300 Aug 01 14:17:16.186003 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 457/897] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:17:16.855329 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:16.856069 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:16.858783 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:16.864434 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:16.865023 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:16.865847 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:16.866277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:16.870771 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:16.885007 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 HTTP/1.1 Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:17:16.886741 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:17:16.889907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '9704aec6-fe5a-451d-9716-53653d6d48f2'} Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:16.892256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:17:16.895700 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:16.898800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:16.898800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-975e000f-65d5-4e8e-85f7-454dfe8cb4ca tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 404 len: 111 microversion: 2.1 time: 0.037328 Aug 01 14:17:16.898800 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 441/898] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:16 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:17:16.900710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8d1e9c15-90bf-4069-8381-909fdbc9c5d6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '.version_select at 0x7fc579629820>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:16.922666 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8d1e9c15-90bf-4069-8381-909fdbc9c5d6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131438269" status: 202 len: 0 microversion: 2.1 time: 0.027540 Aug 01 14:17:16.923299 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 458/899] 10.222.0.45 () {58 vars in 1221 bytes} [Mon Aug 1 14:17:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131438269 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:17:17.744527 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6f11607a-93b2-428c-8dbf-a2219ac602cf tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:17.745015 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6f11607a-93b2-428c-8dbf-a2219ac602cf tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:17.751563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6f11607a-93b2-428c-8dbf-a2219ac602cf tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:17.752006 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6f11607a-93b2-428c-8dbf-a2219ac602cf tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:17.752801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6f11607a-93b2-428c-8dbf-a2219ac602cf tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:17.753240 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6f11607a-93b2-428c-8dbf-a2219ac602cf tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:17.871168 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-6f11607a-93b2-428c-8dbf-a2219ac602cf tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lazy-loading 'services' on Instance uuid 730a6765-52cd-4528-9957-3165769c0820 {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:17:17.965581 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6f11607a-93b2-428c-8dbf-a2219ac602cf tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-volume_attachments/9fb4f9fc-a69e-4825-b6ed-654149712634" status: 202 len: 0 microversion: 2.1 time: 0.225196 Aug 01 14:17:17.970725 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 442/900] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:17:17 2022] DELETE /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-volume_attachments/9fb4f9fc-a69e-4825-b6ed-654149712634 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:17:17.979444 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e239437f-c98a-4b2e-93f7-c571542a6a29 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:17.985555 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e239437f-c98a-4b2e-93f7-c571542a6a29 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:17.990897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:18.009669 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e239437f-c98a-4b2e-93f7-c571542a6a29 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:18.011859 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e239437f-c98a-4b2e-93f7-c571542a6a29 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:18.013087 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e239437f-c98a-4b2e-93f7-c571542a6a29 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:18.013748 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e239437f-c98a-4b2e-93f7-c571542a6a29 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:18.021789 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:18.056554 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e239437f-c98a-4b2e-93f7-c571542a6a29 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084182 Aug 01 14:17:18.061324 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 459/901] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:17:17 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:18.166332 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1769449566", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-923806228", "security_groups": [{"name": "tempest-secgroup-smoke-1476544160"}], "block_device_mapping_v2": [{"uuid": "51b1a424-a408-41a5-abc7-81cf036bdcc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e95fe17e-40dc-4b82-adc2-9adb31102a43"}]}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:18.336111 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] validate_networks() for [('e95fe17e-40dc-4b82-adc2-9adb31102a43', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:17:19.069381 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-10012a7a-4628-4ff8-8cff-33a8e380f907 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:19.071701 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-10012a7a-4628-4ff8-8cff-33a8e380f907 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:19.078965 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-10012a7a-4628-4ff8-8cff-33a8e380f907 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:19.079506 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-10012a7a-4628-4ff8-8cff-33a8e380f907 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:19.080401 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-10012a7a-4628-4ff8-8cff-33a8e380f907 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:19.080830 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-10012a7a-4628-4ff8-8cff-33a8e380f907 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:19.092622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:17:19.093130 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:17:19.093504 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:17:19.093917 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:17:19.094370 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:17:19.103925 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:19.104401 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:19.105199 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:19.105630 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:19.111240 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-10012a7a-4628-4ff8-8cff-33a8e380f907 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045892 Aug 01 14:17:19.111801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 460/902] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:17:19 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:17:19.122956 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Getting quotas for project f0a6c07d69ef4cf4a545f48e7079044d. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:17:19.127643 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Getting quotas for user 8e30910692b4474092f1585a671e2f41 and project f0a6c07d69ef4cf4a545f48e7079044d. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:17:19.180875 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bea262e1-f4f9-4d6a-8fb6-dde940f58326 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:19.181366 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bea262e1-f4f9-4d6a-8fb6-dde940f58326 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:19.189593 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bea262e1-f4f9-4d6a-8fb6-dde940f58326 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:19.190184 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bea262e1-f4f9-4d6a-8fb6-dde940f58326 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:19.190837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bea262e1-f4f9-4d6a-8fb6-dde940f58326 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:19.191282 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bea262e1-f4f9-4d6a-8fb6-dde940f58326 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:19.192306 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:17:19.194608 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51b1a424-a408-41a5-abc7-81cf036bdcc7',volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:17:19.223307 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bea262e1-f4f9-4d6a-8fb6-dde940f58326 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:17:19.325770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bea262e1-f4f9-4d6a-8fb6-dde940f58326 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 204 len: 0 microversion: 2.1 time: 0.148524 Aug 01 14:17:19.329606 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 461/903] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:17:19 2022] DELETE /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:17:19.341427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-744b80b9-a456-4978-adef-4bc3e5fc82cd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:19.341427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-744b80b9-a456-4978-adef-4bc3e5fc82cd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:19.349992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-744b80b9-a456-4978-adef-4bc3e5fc82cd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:19.350767 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-744b80b9-a456-4978-adef-4bc3e5fc82cd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:19.352262 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-744b80b9-a456-4978-adef-4bc3e5fc82cd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:19.353278 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-744b80b9-a456-4978-adef-4bc3e5fc82cd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:19.399486 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-86053672-1fb8-491c-a62d-c25f84a5d362 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.237489 Aug 01 14:17:19.400566 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 443/904] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:17:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:17:19.420440 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b694ce9a-a02c-43cd-a03b-143c7dc33a87 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:19.422023 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b694ce9a-a02c-43cd-a03b-143c7dc33a87 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:19.564756 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-b694ce9a-a02c-43cd-a03b-143c7dc33a87 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:19.576229 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b694ce9a-a02c-43cd-a03b-143c7dc33a87 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1094 microversion: 2.1 time: 0.167722 Aug 01 14:17:19.579294 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 444/905] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:19 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1094 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:19.613764 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-744b80b9-a456-4978-adef-4bc3e5fc82cd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:19.623613 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-744b80b9-a456-4978-adef-4bc3e5fc82cd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1678 microversion: 2.1 time: 0.290146 Aug 01 14:17:19.624519 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 462/906] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:19 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1678 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:20.609563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f43433e3-71dc-4473-94e1-7bce86a12523 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:20.610377 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f43433e3-71dc-4473-94e1-7bce86a12523 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:20.618388 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f43433e3-71dc-4473-94e1-7bce86a12523 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:20.618880 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f43433e3-71dc-4473-94e1-7bce86a12523 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:20.619769 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f43433e3-71dc-4473-94e1-7bce86a12523 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:20.620304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f43433e3-71dc-4473-94e1-7bce86a12523 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:20.645747 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-53bbea0f-25d0-414c-8562-efb840a81ee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:20.647443 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-53bbea0f-25d0-414c-8562-efb840a81ee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:20.659269 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53bbea0f-25d0-414c-8562-efb840a81ee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:20.659812 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53bbea0f-25d0-414c-8562-efb840a81ee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:20.661846 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53bbea0f-25d0-414c-8562-efb840a81ee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:20.662380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-53bbea0f-25d0-414c-8562-efb840a81ee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:20.695013 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f43433e3-71dc-4473-94e1-7bce86a12523 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:20.703676 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f43433e3-71dc-4473-94e1-7bce86a12523 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1144 microversion: 2.1 time: 0.098708 Aug 01 14:17:20.704292 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 445/907] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:20 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:20.834782 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-53bbea0f-25d0-414c-8562-efb840a81ee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:20.847041 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-53bbea0f-25d0-414c-8562-efb840a81ee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1678 microversion: 2.1 time: 0.206200 Aug 01 14:17:20.847634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 463/908] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:20 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:21.726606 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-cb02cee5-dcbc-4aa1-bc37-65829e156999 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:21.727486 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-cb02cee5-dcbc-4aa1-bc37-65829e156999 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:21.737391 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cb02cee5-dcbc-4aa1-bc37-65829e156999 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:21.738551 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cb02cee5-dcbc-4aa1-bc37-65829e156999 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:21.739929 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cb02cee5-dcbc-4aa1-bc37-65829e156999 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:21.740963 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cb02cee5-dcbc-4aa1-bc37-65829e156999 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:21.879159 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-565ad2f0-f928-421e-99f8-b29a25ec3c78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:21.879932 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-565ad2f0-f928-421e-99f8-b29a25ec3c78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:21.888829 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-565ad2f0-f928-421e-99f8-b29a25ec3c78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:21.889572 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-565ad2f0-f928-421e-99f8-b29a25ec3c78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:21.890592 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-565ad2f0-f928-421e-99f8-b29a25ec3c78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:21.891096 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-565ad2f0-f928-421e-99f8-b29a25ec3c78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:21.897261 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-cb02cee5-dcbc-4aa1-bc37-65829e156999 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:21.919639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-cb02cee5-dcbc-4aa1-bc37-65829e156999 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1210 microversion: 2.1 time: 0.196686 Aug 01 14:17:21.921697 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 446/909] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:21 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1210 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:22.395045 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-565ad2f0-f928-421e-99f8-b29a25ec3c78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:22.408887 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-565ad2f0-f928-421e-99f8-b29a25ec3c78 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1678 microversion: 2.1 time: 0.534006 Aug 01 14:17:22.409790 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 464/910] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:21 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1678 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:17:22.885999 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-afdfdb3f-d68c-4c74-9519-1f9a78271ce1 req-7cf9c49e-233e-477c-9ca1-8e54e6af8491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730a6765-52cd-4528-9957-3165769c0820", "name": "network-vif-deleted", "tag": "84a9217a-963b-4cc2-9c3d-d50aea2772d1"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:22.902851 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-afdfdb3f-d68c-4c74-9519-1f9a78271ce1 req-7cf9c49e-233e-477c-9ca1-8e54e6af8491 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:22.903964 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-afdfdb3f-d68c-4c74-9519-1f9a78271ce1 req-7cf9c49e-233e-477c-9ca1-8e54e6af8491 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:22.922335 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-afdfdb3f-d68c-4c74-9519-1f9a78271ce1 req-7cf9c49e-233e-477c-9ca1-8e54e6af8491 service nova] Creating event network-vif-deleted:84a9217a-963b-4cc2-9c3d-d50aea2772d1 for instance 730a6765-52cd-4528-9957-3165769c0820 on hv-cinder-84517 Aug 01 14:17:22.931990 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-afdfdb3f-d68c-4c74-9519-1f9a78271ce1 req-7cf9c49e-233e-477c-9ca1-8e54e6af8491 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058363 Aug 01 14:17:22.933617 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 447/911] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:22.960010 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3834e2b2-24ee-4f54-8438-03ef605d1e15 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:22.961178 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3834e2b2-24ee-4f54-8438-03ef605d1e15 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:22.994083 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3834e2b2-24ee-4f54-8438-03ef605d1e15 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:22.994867 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3834e2b2-24ee-4f54-8438-03ef605d1e15 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:22.996413 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3834e2b2-24ee-4f54-8438-03ef605d1e15 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:22.997136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3834e2b2-24ee-4f54-8438-03ef605d1e15 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:23.326390 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3834e2b2-24ee-4f54-8438-03ef605d1e15 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:23.344064 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3834e2b2-24ee-4f54-8438-03ef605d1e15 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.389091 Aug 01 14:17:23.345244 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 465/912] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:22 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:23.460804 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:23.462677 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:23.486202 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:23.486891 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:23.497705 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:23.498433 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:23.582718 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:23.583510 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:23.584140 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lazy-loading 'fault' on Instance uuid 730a6765-52cd-4528-9957-3165769c0820 {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:17:23.686292 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:23.703842 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0dfdf792-1b48-45d2-85fc-84367a02f177 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 200 len: 1330 microversion: 2.1 time: 0.272811 Aug 01 14:17:23.706490 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 448/913] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:23 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 1330 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:24.388752 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1886f72a-cfb1-4205-8897-dd9412e1c368 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:24.391796 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1886f72a-cfb1-4205-8897-dd9412e1c368 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:24.430607 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1886f72a-cfb1-4205-8897-dd9412e1c368 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:24.431430 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1886f72a-cfb1-4205-8897-dd9412e1c368 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:24.443768 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1886f72a-cfb1-4205-8897-dd9412e1c368 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:24.443768 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1886f72a-cfb1-4205-8897-dd9412e1c368 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:24.741792 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:24.744215 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:24.752302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:24.753012 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:24.753951 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:24.754377 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:24.769563 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 HTTP/1.1 Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:17:24.771598 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:17:24.773269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '730a6765-52cd-4528-9957-3165769c0820'} Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:24.774263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:17:24.775688 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:17:24.778332 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:24.778332 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d11701eb-a502-4998-9fd8-b43af7cf9aed tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 404 len: 111 microversion: 2.1 time: 0.038008 Aug 01 14:17:24.778332 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 449/914] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:24 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:17:24.782940 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1d274a19-7794-432a-8d4d-8d79617397e1 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '.version_select at 0x7fc579701310>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:24.807322 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1d274a19-7794-432a-8d4d-8d79617397e1 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598913868" status: 202 len: 0 microversion: 2.1 time: 0.027591 Aug 01 14:17:24.808294 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 450/915] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 14:17:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598913868 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:17:24.877093 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1886f72a-cfb1-4205-8897-dd9412e1c368 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:24.888524 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1886f72a-cfb1-4205-8897-dd9412e1c368 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.516470 Aug 01 14:17:24.889187 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 466/916] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:24 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:24.964157 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-da064d83-d796-46e8-a045-177eba737600 req-e8f12af0-bbd9-48f8-8166-b28d416f5c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c15868-3e72-4d3f-9b87-00f3d51127c4", "tag": "2945d68d-3b91-4d52-b13b-c25098ca3225"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:24.981452 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-da064d83-d796-46e8-a045-177eba737600 req-e8f12af0-bbd9-48f8-8166-b28d416f5c84 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:24.982114 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-da064d83-d796-46e8-a045-177eba737600 req-e8f12af0-bbd9-48f8-8166-b28d416f5c84 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:24.996617 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-da064d83-d796-46e8-a045-177eba737600 req-e8f12af0-bbd9-48f8-8166-b28d416f5c84 service nova] Creating event network-changed:2945d68d-3b91-4d52-b13b-c25098ca3225 for instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 on hv-cinder-84517 Aug 01 14:17:25.003540 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-da064d83-d796-46e8-a045-177eba737600 req-e8f12af0-bbd9-48f8-8166-b28d416f5c84 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047755 Aug 01 14:17:25.005315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 451/917] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:25.779184 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-68fc88f5-4c59-4e12-88ca-64bd0d3323b2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: .version_select at 0x7fc579629940>, body: {"keypair": {"name": "tempest-keypair-647152098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+EdCesgUTJuRPOhxMjQALrBv1hdIZiWowF2aX8xCXUaYxdwCzUPwLD7ABsczbhO6IBVR22fg1wjhYroKprwCDARxBnj4r/DjDE6fVVeEdk24gl/eqWxqd3CQOkTOE5XQ=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:25.798885 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-68fc88f5-4c59-4e12-88ca-64bd0d3323b2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for project db87d8b3358945aa88acbdc4246917ae. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:17:25.803997 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-68fc88f5-4c59-4e12-88ca-64bd0d3323b2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for user a9fc33bdca304c33b6a78122a54f492a and project db87d8b3358945aa88acbdc4246917ae. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:17:25.833852 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-68fc88f5-4c59-4e12-88ca-64bd0d3323b2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058763 Aug 01 14:17:25.835860 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 467/918] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:17:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:25.918958 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1a545cb2-8157-40bf-bb56-2ec672be07e7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:25.938293 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1a545cb2-8157-40bf-bb56-2ec672be07e7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:25.961945 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1a545cb2-8157-40bf-bb56-2ec672be07e7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:25.963135 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1a545cb2-8157-40bf-bb56-2ec672be07e7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:25.966353 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1a545cb2-8157-40bf-bb56-2ec672be07e7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:25.967433 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1a545cb2-8157-40bf-bb56-2ec672be07e7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:26.372367 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1a545cb2-8157-40bf-bb56-2ec672be07e7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:26.389642 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1a545cb2-8157-40bf-bb56-2ec672be07e7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.478653 Aug 01 14:17:26.393103 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 452/919] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:25 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:27.425791 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0ccbbb47-3cca-42e2-ae6f-e6b918298a8b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:27.426572 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0ccbbb47-3cca-42e2-ae6f-e6b918298a8b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:27.434815 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0ccbbb47-3cca-42e2-ae6f-e6b918298a8b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:27.435570 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0ccbbb47-3cca-42e2-ae6f-e6b918298a8b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:27.437032 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0ccbbb47-3cca-42e2-ae6f-e6b918298a8b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:27.437632 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0ccbbb47-3cca-42e2-ae6f-e6b918298a8b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:27.647933 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0ccbbb47-3cca-42e2-ae6f-e6b918298a8b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:27.656946 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0ccbbb47-3cca-42e2-ae6f-e6b918298a8b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.235341 Aug 01 14:17:27.657772 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 468/920] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:27 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:17:27.731295 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1489366012", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1987c22e-ab83-4108-bc22-29b9909b71a1"}], "security_groups": [{"name": "tempest-securitygroup--799135836"}], "key_name": "tempest-keypair-647152098", "user_data": "}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:27.848620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.network.neutron [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] validate_networks() for [('1987c22e-ab83-4108-bc22-29b9909b71a1', None, None, None, None, None)] {{(pid=118110) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:17:28.259659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Flavor limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:17:28.260067 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Image limits 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:17:28.260589 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Flavor pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:17:28.260992 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Image pref 0:0:0 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:17:28.261409 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.virt.hardware [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:17:28.272207 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:28.272699 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:28.273518 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:28.273958 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:28.294836 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for project db87d8b3358945aa88acbdc4246917ae. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:17:28.299621 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for user a9fc33bdca304c33b6a78122a54f492a and project db87d8b3358945aa88acbdc4246917ae. Resources: {'cores', 'instances', 'ram'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:17:28.313031 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Going to run 1 instances... {{(pid=118110) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:17:28.315320 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:17:28.367949 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-b11809a6-59eb-4d29-91ae-b194ad23e5ec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.641349 Aug 01 14:17:28.368634 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 453/921] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:17:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:17:28.381168 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d37782a2-6c08-49eb-97fe-082e477f98f9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:28.381999 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d37782a2-6c08-49eb-97fe-082e477f98f9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:28.447913 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d37782a2-6c08-49eb-97fe-082e477f98f9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:28.455751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d37782a2-6c08-49eb-97fe-082e477f98f9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1241 microversion: 2.1 time: 0.079687 Aug 01 14:17:28.456472 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 469/922] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:28 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:28.690186 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3de07f04-a36d-4f88-8c3f-2de4877a96de tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:28.691344 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3de07f04-a36d-4f88-8c3f-2de4877a96de tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:28.702824 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3de07f04-a36d-4f88-8c3f-2de4877a96de tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:28.703651 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3de07f04-a36d-4f88-8c3f-2de4877a96de tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:28.705034 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3de07f04-a36d-4f88-8c3f-2de4877a96de tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:28.705775 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3de07f04-a36d-4f88-8c3f-2de4877a96de tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:28.911569 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3de07f04-a36d-4f88-8c3f-2de4877a96de tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:28.925893 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3de07f04-a36d-4f88-8c3f-2de4877a96de tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.242657 Aug 01 14:17:28.933633 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 454/923] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:28 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:29.478327 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4aa9d9d4-481f-4a9e-81d6-e72ff32abde3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:29.479130 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4aa9d9d4-481f-4a9e-81d6-e72ff32abde3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:29.487773 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4aa9d9d4-481f-4a9e-81d6-e72ff32abde3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:29.488234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4aa9d9d4-481f-4a9e-81d6-e72ff32abde3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:29.489169 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4aa9d9d4-481f-4a9e-81d6-e72ff32abde3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:29.489658 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4aa9d9d4-481f-4a9e-81d6-e72ff32abde3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:29.563247 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4aa9d9d4-481f-4a9e-81d6-e72ff32abde3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:29.577303 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4aa9d9d4-481f-4a9e-81d6-e72ff32abde3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1245 microversion: 2.1 time: 0.103213 Aug 01 14:17:29.578202 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 470/924] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:29 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:17:29.951479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0f785fca-b17b-45c7-b784-6558e132aca2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:29.952496 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0f785fca-b17b-45c7-b784-6558e132aca2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:29.963051 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0f785fca-b17b-45c7-b784-6558e132aca2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:29.963501 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0f785fca-b17b-45c7-b784-6558e132aca2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:29.964313 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0f785fca-b17b-45c7-b784-6558e132aca2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:29.964750 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0f785fca-b17b-45c7-b784-6558e132aca2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:30.128207 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0f785fca-b17b-45c7-b784-6558e132aca2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:30.137552 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0f785fca-b17b-45c7-b784-6558e132aca2 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.190790 Aug 01 14:17:30.138176 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 455/925] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:29 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:30.599862 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3a7c1e8b-9415-4a7e-88a9-16146d3471b8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:30.600543 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3a7c1e8b-9415-4a7e-88a9-16146d3471b8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:30.607985 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a7c1e8b-9415-4a7e-88a9-16146d3471b8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:30.608467 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a7c1e8b-9415-4a7e-88a9-16146d3471b8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:30.609254 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a7c1e8b-9415-4a7e-88a9-16146d3471b8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:30.609687 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a7c1e8b-9415-4a7e-88a9-16146d3471b8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:30.703412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3a7c1e8b-9415-4a7e-88a9-16146d3471b8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:30.714430 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3a7c1e8b-9415-4a7e-88a9-16146d3471b8 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1237 microversion: 2.1 time: 0.118962 Aug 01 14:17:30.715023 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 471/926] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:30 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:31.164437 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4188e9e2-038b-48c3-b3a4-61ea7b850eb3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:31.164437 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4188e9e2-038b-48c3-b3a4-61ea7b850eb3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:31.171215 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4188e9e2-038b-48c3-b3a4-61ea7b850eb3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:31.171648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4188e9e2-038b-48c3-b3a4-61ea7b850eb3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:31.172509 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4188e9e2-038b-48c3-b3a4-61ea7b850eb3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:31.172958 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4188e9e2-038b-48c3-b3a4-61ea7b850eb3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:31.324228 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-4188e9e2-038b-48c3-b3a4-61ea7b850eb3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:31.332377 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4188e9e2-038b-48c3-b3a4-61ea7b850eb3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.173591 Aug 01 14:17:31.333024 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 456/927] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:31 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:31.736238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a2330542-fda4-4c81-ba56-b4b0354f636c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:31.736876 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a2330542-fda4-4c81-ba56-b4b0354f636c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:31.744172 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a2330542-fda4-4c81-ba56-b4b0354f636c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:31.744555 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a2330542-fda4-4c81-ba56-b4b0354f636c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:31.745319 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a2330542-fda4-4c81-ba56-b4b0354f636c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:31.745741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a2330542-fda4-4c81-ba56-b4b0354f636c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:31.813811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a2330542-fda4-4c81-ba56-b4b0354f636c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:31.822245 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a2330542-fda4-4c81-ba56-b4b0354f636c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1293 microversion: 2.1 time: 0.089862 Aug 01 14:17:31.822833 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 472/928] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:31 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:17:32.354029 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-71de3c0f-6cc3-4e70-8891-68b6e2dbe5c7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:32.354729 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-71de3c0f-6cc3-4e70-8891-68b6e2dbe5c7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:32.361622 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-71de3c0f-6cc3-4e70-8891-68b6e2dbe5c7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:32.362125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-71de3c0f-6cc3-4e70-8891-68b6e2dbe5c7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:32.362902 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-71de3c0f-6cc3-4e70-8891-68b6e2dbe5c7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:32.363337 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-71de3c0f-6cc3-4e70-8891-68b6e2dbe5c7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:32.566620 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-71de3c0f-6cc3-4e70-8891-68b6e2dbe5c7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:32.574897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-71de3c0f-6cc3-4e70-8891-68b6e2dbe5c7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.226173 Aug 01 14:17:32.575480 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 457/929] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:32 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:32.843243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b8375371-49bc-4a00-bcd2-ab9d1a45c711 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:32.844577 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b8375371-49bc-4a00-bcd2-ab9d1a45c711 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:32.852094 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8375371-49bc-4a00-bcd2-ab9d1a45c711 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:32.852790 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8375371-49bc-4a00-bcd2-ab9d1a45c711 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:32.853608 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8375371-49bc-4a00-bcd2-ab9d1a45c711 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:32.854195 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8375371-49bc-4a00-bcd2-ab9d1a45c711 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:33.102352 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b8375371-49bc-4a00-bcd2-ab9d1a45c711 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:33.112507 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b8375371-49bc-4a00-bcd2-ab9d1a45c711 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.272800 Aug 01 14:17:33.113572 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 473/930] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:32 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:17:33.599071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ce638860-28b7-4ea3-ac00-6ed2a36e14a9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:33.599734 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ce638860-28b7-4ea3-ac00-6ed2a36e14a9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:33.607325 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ce638860-28b7-4ea3-ac00-6ed2a36e14a9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:33.607778 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ce638860-28b7-4ea3-ac00-6ed2a36e14a9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:33.608649 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ce638860-28b7-4ea3-ac00-6ed2a36e14a9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:33.608991 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ce638860-28b7-4ea3-ac00-6ed2a36e14a9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:33.747886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ce638860-28b7-4ea3-ac00-6ed2a36e14a9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:33.759097 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ce638860-28b7-4ea3-ac00-6ed2a36e14a9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.163994 Aug 01 14:17:33.759696 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 458/931] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:33 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:34.134994 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5b948482-c7a9-4ed1-85a9-b8c25ed03f85 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:34.135636 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5b948482-c7a9-4ed1-85a9-b8c25ed03f85 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:34.143688 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b948482-c7a9-4ed1-85a9-b8c25ed03f85 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:34.144137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b948482-c7a9-4ed1-85a9-b8c25ed03f85 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:34.144980 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b948482-c7a9-4ed1-85a9-b8c25ed03f85 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:34.145492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b948482-c7a9-4ed1-85a9-b8c25ed03f85 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:34.324135 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5b948482-c7a9-4ed1-85a9-b8c25ed03f85 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:34.332184 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5b948482-c7a9-4ed1-85a9-b8c25ed03f85 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.201145 Aug 01 14:17:34.332865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 474/932] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:34 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:34.780623 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-cf3e11b9-c1a3-4966-a0c3-88c5a66d95ae tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:34.781469 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-cf3e11b9-c1a3-4966-a0c3-88c5a66d95ae tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:34.792098 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cf3e11b9-c1a3-4966-a0c3-88c5a66d95ae tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:34.793173 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cf3e11b9-c1a3-4966-a0c3-88c5a66d95ae tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:34.794648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cf3e11b9-c1a3-4966-a0c3-88c5a66d95ae tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:34.795536 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cf3e11b9-c1a3-4966-a0c3-88c5a66d95ae tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:35.025129 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-cf3e11b9-c1a3-4966-a0c3-88c5a66d95ae tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:35.033702 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-cf3e11b9-c1a3-4966-a0c3-88c5a66d95ae tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.257062 Aug 01 14:17:35.035690 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 459/933] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:34 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:35.126200 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-c99768f4-a8de-443a-a326-885b7cd098cb req-30305673-e29f-4157-a624-8105580fdbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705cc9b9-fac2-4ec1-8137-d1993552b6a4", "tag": "3f82595f-922a-4da1-bb87-ffcee50a548a"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:35.138701 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c99768f4-a8de-443a-a326-885b7cd098cb req-30305673-e29f-4157-a624-8105580fdbd4 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:35.139777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c99768f4-a8de-443a-a326-885b7cd098cb req-30305673-e29f-4157-a624-8105580fdbd4 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:35.151356 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-c99768f4-a8de-443a-a326-885b7cd098cb req-30305673-e29f-4157-a624-8105580fdbd4 service nova] Creating event network-changed:3f82595f-922a-4da1-bb87-ffcee50a548a for instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 on hv-cinder-84517 Aug 01 14:17:35.156815 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-c99768f4-a8de-443a-a326-885b7cd098cb req-30305673-e29f-4157-a624-8105580fdbd4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034295 Aug 01 14:17:35.157654 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 475/934] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:35.354714 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ab3724d0-4826-4b8d-bf96-8259c1cf768f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:35.355357 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ab3724d0-4826-4b8d-bf96-8259c1cf768f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:35.365461 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab3724d0-4826-4b8d-bf96-8259c1cf768f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:35.366267 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab3724d0-4826-4b8d-bf96-8259c1cf768f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:35.367758 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab3724d0-4826-4b8d-bf96-8259c1cf768f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:35.368575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ab3724d0-4826-4b8d-bf96-8259c1cf768f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:35.604914 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ab3724d0-4826-4b8d-bf96-8259c1cf768f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:35.613502 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ab3724d0-4826-4b8d-bf96-8259c1cf768f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.263571 Aug 01 14:17:35.614244 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 460/935] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:35 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:36.061005 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3568c1af-bb9a-42c8-81b0-b2aa3188896a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:36.061837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3568c1af-bb9a-42c8-81b0-b2aa3188896a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:36.068929 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3568c1af-bb9a-42c8-81b0-b2aa3188896a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:36.069394 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3568c1af-bb9a-42c8-81b0-b2aa3188896a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:36.070193 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3568c1af-bb9a-42c8-81b0-b2aa3188896a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:36.070645 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3568c1af-bb9a-42c8-81b0-b2aa3188896a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:36.261772 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3568c1af-bb9a-42c8-81b0-b2aa3188896a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:36.264291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:36.272502 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3568c1af-bb9a-42c8-81b0-b2aa3188896a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.216989 Aug 01 14:17:36.273106 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 476/936] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:36 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:36.635662 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f3fbd13f-c990-4baf-8a43-935c835ac894 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:36.636812 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f3fbd13f-c990-4baf-8a43-935c835ac894 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:36.645108 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f3fbd13f-c990-4baf-8a43-935c835ac894 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:36.646164 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f3fbd13f-c990-4baf-8a43-935c835ac894 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:36.647030 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f3fbd13f-c990-4baf-8a43-935c835ac894 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:36.647703 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f3fbd13f-c990-4baf-8a43-935c835ac894 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:36.862208 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f3fbd13f-c990-4baf-8a43-935c835ac894 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:36.870615 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f3fbd13f-c990-4baf-8a43-935c835ac894 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.239417 Aug 01 14:17:36.871205 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 461/937] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:36 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:37.294234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-24c99066-f1a7-4e9d-ad0f-27b2ace8e59e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:37.294849 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-24c99066-f1a7-4e9d-ad0f-27b2ace8e59e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:37.302480 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-24c99066-f1a7-4e9d-ad0f-27b2ace8e59e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:37.302926 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-24c99066-f1a7-4e9d-ad0f-27b2ace8e59e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:37.303712 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-24c99066-f1a7-4e9d-ad0f-27b2ace8e59e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:37.304142 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-24c99066-f1a7-4e9d-ad0f-27b2ace8e59e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:37.453949 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-24c99066-f1a7-4e9d-ad0f-27b2ace8e59e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:37.462026 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-24c99066-f1a7-4e9d-ad0f-27b2ace8e59e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.171888 Aug 01 14:17:37.462615 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 477/938] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:37 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:37.893077 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a21ab411-3e6e-4ac6-9b9a-1099a54aac48 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:37.893785 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a21ab411-3e6e-4ac6-9b9a-1099a54aac48 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:37.903593 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a21ab411-3e6e-4ac6-9b9a-1099a54aac48 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:37.904166 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a21ab411-3e6e-4ac6-9b9a-1099a54aac48 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:37.905071 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a21ab411-3e6e-4ac6-9b9a-1099a54aac48 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:37.905570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a21ab411-3e6e-4ac6-9b9a-1099a54aac48 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:38.085631 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a21ab411-3e6e-4ac6-9b9a-1099a54aac48 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:38.088228 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:38.095048 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a21ab411-3e6e-4ac6-9b9a-1099a54aac48 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.206121 Aug 01 14:17:38.096058 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 462/939] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:37 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:38.483537 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2298d799-206e-4a59-865d-91956710add3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:38.484146 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2298d799-206e-4a59-865d-91956710add3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:38.486523 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:38.496733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2298d799-206e-4a59-865d-91956710add3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:38.496733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2298d799-206e-4a59-865d-91956710add3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:38.496733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2298d799-206e-4a59-865d-91956710add3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:38.496733 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2298d799-206e-4a59-865d-91956710add3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:38.658238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2298d799-206e-4a59-865d-91956710add3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:38.666641 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2298d799-206e-4a59-865d-91956710add3 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.187114 Aug 01 14:17:38.667231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 478/940] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:38 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:39.117014 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3c90a0e1-5176-48af-b115-63a4b45c000d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:39.117615 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3c90a0e1-5176-48af-b115-63a4b45c000d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:39.120045 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=4 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:39.120772 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=14 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:39.127923 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c90a0e1-5176-48af-b115-63a4b45c000d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:39.128398 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c90a0e1-5176-48af-b115-63a4b45c000d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:39.129263 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c90a0e1-5176-48af-b115-63a4b45c000d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:39.129609 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3c90a0e1-5176-48af-b115-63a4b45c000d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:39.268831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-3c90a0e1-5176-48af-b115-63a4b45c000d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:39.277154 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3c90a0e1-5176-48af-b115-63a4b45c000d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.164318 Aug 01 14:17:39.277934 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 463/941] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:39 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:39.688568 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d33b3887-4f76-404a-b1a7-75a907c1be49 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:39.689124 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d33b3887-4f76-404a-b1a7-75a907c1be49 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:39.695973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d33b3887-4f76-404a-b1a7-75a907c1be49 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:39.696481 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d33b3887-4f76-404a-b1a7-75a907c1be49 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:39.697257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d33b3887-4f76-404a-b1a7-75a907c1be49 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:39.697687 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d33b3887-4f76-404a-b1a7-75a907c1be49 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:39.840872 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d33b3887-4f76-404a-b1a7-75a907c1be49 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:39.849127 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d33b3887-4f76-404a-b1a7-75a907c1be49 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.164642 Aug 01 14:17:39.849711 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 479/942] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:39 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:40.230752 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-39829fdf-c43d-49e3-918c-13a96bcd5a69 req-8ce14d91-4d2b-4530-b77e-76ace8a408a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c15868-3e72-4d3f-9b87-00f3d51127c4", "name": "network-vif-plugged", "status": "completed", "tag": "2945d68d-3b91-4d52-b13b-c25098ca3225"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:40.242882 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-39829fdf-c43d-49e3-918c-13a96bcd5a69 req-8ce14d91-4d2b-4530-b77e-76ace8a408a1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:40.243295 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-39829fdf-c43d-49e3-918c-13a96bcd5a69 req-8ce14d91-4d2b-4530-b77e-76ace8a408a1 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:40.256530 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-39829fdf-c43d-49e3-918c-13a96bcd5a69 req-8ce14d91-4d2b-4530-b77e-76ace8a408a1 service nova] Creating event network-vif-plugged:2945d68d-3b91-4d52-b13b-c25098ca3225 for instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 on hv-cinder-84517 Aug 01 14:17:40.272213 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-39829fdf-c43d-49e3-918c-13a96bcd5a69 req-8ce14d91-4d2b-4530-b77e-76ace8a408a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045830 Aug 01 14:17:40.272909 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 464/943] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:40.298680 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5c48c530-c907-4ed4-a949-d32891a5a6e0 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:40.299335 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5c48c530-c907-4ed4-a949-d32891a5a6e0 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:40.306668 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c48c530-c907-4ed4-a949-d32891a5a6e0 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:40.306934 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c48c530-c907-4ed4-a949-d32891a5a6e0 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:40.307770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c48c530-c907-4ed4-a949-d32891a5a6e0 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:40.308185 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c48c530-c907-4ed4-a949-d32891a5a6e0 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:40.457300 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5c48c530-c907-4ed4-a949-d32891a5a6e0 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:40.467244 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5c48c530-c907-4ed4-a949-d32891a5a6e0 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.172567 Aug 01 14:17:40.467906 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 480/944] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:40 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:40.871076 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-21378167-0a7c-45ab-95d1-5e8cf016bd64 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:40.871782 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-21378167-0a7c-45ab-95d1-5e8cf016bd64 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:40.878439 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-21378167-0a7c-45ab-95d1-5e8cf016bd64 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:40.878883 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-21378167-0a7c-45ab-95d1-5e8cf016bd64 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:40.879683 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-21378167-0a7c-45ab-95d1-5e8cf016bd64 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:40.880115 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-21378167-0a7c-45ab-95d1-5e8cf016bd64 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:41.024230 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-21378167-0a7c-45ab-95d1-5e8cf016bd64 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:41.033830 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-21378167-0a7c-45ab-95d1-5e8cf016bd64 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.167024 Aug 01 14:17:41.034415 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 465/945] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:40 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:41.489820 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0bc94ee8-60f5-4710-a49c-32d57a037a97 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:41.490535 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0bc94ee8-60f5-4710-a49c-32d57a037a97 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:41.498425 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bc94ee8-60f5-4710-a49c-32d57a037a97 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:41.498845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bc94ee8-60f5-4710-a49c-32d57a037a97 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:41.500137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bc94ee8-60f5-4710-a49c-32d57a037a97 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:41.500781 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bc94ee8-60f5-4710-a49c-32d57a037a97 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:41.648528 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0bc94ee8-60f5-4710-a49c-32d57a037a97 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:41.661045 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0bc94ee8-60f5-4710-a49c-32d57a037a97 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.174937 Aug 01 14:17:41.661639 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 481/946] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:41 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:42.062296 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1e57b815-63fc-45ca-92a4-ddf78f5d047f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:42.062928 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1e57b815-63fc-45ca-92a4-ddf78f5d047f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:42.069812 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1e57b815-63fc-45ca-92a4-ddf78f5d047f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:42.070283 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1e57b815-63fc-45ca-92a4-ddf78f5d047f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:42.071053 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1e57b815-63fc-45ca-92a4-ddf78f5d047f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:42.071479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1e57b815-63fc-45ca-92a4-ddf78f5d047f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:42.219315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1e57b815-63fc-45ca-92a4-ddf78f5d047f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:42.227432 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1e57b815-63fc-45ca-92a4-ddf78f5d047f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1266 microversion: 2.1 time: 0.168985 Aug 01 14:17:42.228051 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 466/947] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:42 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:42.686924 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0801bf81-af58-4cbe-a992-f507652b24de tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:42.688143 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0801bf81-af58-4cbe-a992-f507652b24de tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:42.700032 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0801bf81-af58-4cbe-a992-f507652b24de tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:42.700871 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0801bf81-af58-4cbe-a992-f507652b24de tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:42.702276 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0801bf81-af58-4cbe-a992-f507652b24de tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:42.703069 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0801bf81-af58-4cbe-a992-f507652b24de tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:42.865534 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0801bf81-af58-4cbe-a992-f507652b24de tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:42.873020 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0801bf81-af58-4cbe-a992-f507652b24de tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.193833 Aug 01 14:17:42.873569 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 482/948] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:42 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:43.218023 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-d32baae5-d5d2-4b5b-8757-2a3bbe66dbb9 req-b0f8341f-07b9-4b36-b0bc-47507e4bd9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705cc9b9-fac2-4ec1-8137-d1993552b6a4", "name": "network-vif-plugged", "status": "completed", "tag": "3f82595f-922a-4da1-bb87-ffcee50a548a"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:43.231406 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-d32baae5-d5d2-4b5b-8757-2a3bbe66dbb9 req-b0f8341f-07b9-4b36-b0bc-47507e4bd9e7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:43.232139 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-d32baae5-d5d2-4b5b-8757-2a3bbe66dbb9 req-b0f8341f-07b9-4b36-b0bc-47507e4bd9e7 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:43.247329 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-d32baae5-d5d2-4b5b-8757-2a3bbe66dbb9 req-b0f8341f-07b9-4b36-b0bc-47507e4bd9e7 service nova] Creating event network-vif-plugged:3f82595f-922a-4da1-bb87-ffcee50a548a for instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 on hv-cinder-84517 Aug 01 14:17:43.252248 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-019b10f6-0949-43a8-842a-b396997925d9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:43.252556 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-d32baae5-d5d2-4b5b-8757-2a3bbe66dbb9 req-b0f8341f-07b9-4b36-b0bc-47507e4bd9e7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038949 Aug 01 14:17:43.253266 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-019b10f6-0949-43a8-842a-b396997925d9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:43.253396 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 467/949] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:43.260647 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-019b10f6-0949-43a8-842a-b396997925d9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:43.261106 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-019b10f6-0949-43a8-842a-b396997925d9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:43.261982 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-019b10f6-0949-43a8-842a-b396997925d9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:43.262445 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-019b10f6-0949-43a8-842a-b396997925d9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:43.739143 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-019b10f6-0949-43a8-842a-b396997925d9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:43.751817 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-019b10f6-0949-43a8-842a-b396997925d9 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1452 microversion: 2.1 time: 0.505431 Aug 01 14:17:43.752400 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 483/950] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:43 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1452 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:43.773823 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-230ff959-3e7a-42c4-a2f1-6ddd088091f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:43.774555 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-230ff959-3e7a-42c4-a2f1-6ddd088091f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:43.781216 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-230ff959-3e7a-42c4-a2f1-6ddd088091f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:43.781664 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-230ff959-3e7a-42c4-a2f1-6ddd088091f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:43.782444 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-230ff959-3e7a-42c4-a2f1-6ddd088091f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:43.782887 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-230ff959-3e7a-42c4-a2f1-6ddd088091f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:43.894596 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-85761776-75fe-4d24-8624-0b2d0ba0cee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:43.895124 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-85761776-75fe-4d24-8624-0b2d0ba0cee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:43.901613 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85761776-75fe-4d24-8624-0b2d0ba0cee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:43.902187 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85761776-75fe-4d24-8624-0b2d0ba0cee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:43.902833 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85761776-75fe-4d24-8624-0b2d0ba0cee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:43.903262 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85761776-75fe-4d24-8624-0b2d0ba0cee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:43.924241 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-230ff959-3e7a-42c4-a2f1-6ddd088091f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:43.932212 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-230ff959-3e7a-42c4-a2f1-6ddd088091f0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1452 microversion: 2.1 time: 0.163487 Aug 01 14:17:43.932825 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 468/951] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:43 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:44.047712 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-85761776-75fe-4d24-8624-0b2d0ba0cee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:44.055231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-85761776-75fe-4d24-8624-0b2d0ba0cee2 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.164755 Aug 01 14:17:44.055841 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 484/952] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:43 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:17:45.076505 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-277c857d-4d60-4dd7-9f17-4910d9723fff tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:45.077116 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-277c857d-4d60-4dd7-9f17-4910d9723fff tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:45.084042 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-277c857d-4d60-4dd7-9f17-4910d9723fff tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:45.084540 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-277c857d-4d60-4dd7-9f17-4910d9723fff tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:45.085321 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-277c857d-4d60-4dd7-9f17-4910d9723fff tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:45.085757 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-277c857d-4d60-4dd7-9f17-4910d9723fff tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:45.325019 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-277c857d-4d60-4dd7-9f17-4910d9723fff tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:45.333057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-277c857d-4d60-4dd7-9f17-4910d9723fff tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.260521 Aug 01 14:17:45.333721 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 469/953] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:45 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:45.927551 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-419039fc-8ef5-49ef-ba51-f733819538e1 req-4baafe4d-7d27-483b-9aa0-173d275c877c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c15868-3e72-4d3f-9b87-00f3d51127c4", "tag": "2945d68d-3b91-4d52-b13b-c25098ca3225"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:45.937335 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-419039fc-8ef5-49ef-ba51-f733819538e1 req-4baafe4d-7d27-483b-9aa0-173d275c877c service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:45.937785 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-419039fc-8ef5-49ef-ba51-f733819538e1 req-4baafe4d-7d27-483b-9aa0-173d275c877c service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:45.948872 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-419039fc-8ef5-49ef-ba51-f733819538e1 req-4baafe4d-7d27-483b-9aa0-173d275c877c service nova] Creating event network-changed:2945d68d-3b91-4d52-b13b-c25098ca3225 for instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 on hv-cinder-84517 Aug 01 14:17:45.954057 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-419039fc-8ef5-49ef-ba51-f733819538e1 req-4baafe4d-7d27-483b-9aa0-173d275c877c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030464 Aug 01 14:17:45.954663 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 485/954] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:46.354473 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0b933bf4-b496-45e1-ba7b-f518cd8d06aa tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:46.355107 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0b933bf4-b496-45e1-ba7b-f518cd8d06aa tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:46.362066 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0b933bf4-b496-45e1-ba7b-f518cd8d06aa tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:46.362390 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0b933bf4-b496-45e1-ba7b-f518cd8d06aa tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:46.363152 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0b933bf4-b496-45e1-ba7b-f518cd8d06aa tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:46.363575 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0b933bf4-b496-45e1-ba7b-f518cd8d06aa tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:46.517217 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0b933bf4-b496-45e1-ba7b-f518cd8d06aa tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:46.525453 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0b933bf4-b496-45e1-ba7b-f518cd8d06aa tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.175172 Aug 01 14:17:46.526012 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 470/955] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:46 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:47.548766 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-be4b42a9-7e68-430f-9bbf-4443dbac8059 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:47.549496 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-be4b42a9-7e68-430f-9bbf-4443dbac8059 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:47.556989 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be4b42a9-7e68-430f-9bbf-4443dbac8059 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:47.557475 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be4b42a9-7e68-430f-9bbf-4443dbac8059 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:47.558229 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be4b42a9-7e68-430f-9bbf-4443dbac8059 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:47.558676 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be4b42a9-7e68-430f-9bbf-4443dbac8059 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:47.711616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-be4b42a9-7e68-430f-9bbf-4443dbac8059 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:47.719700 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-be4b42a9-7e68-430f-9bbf-4443dbac8059 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1366 microversion: 2.1 time: 0.175853 Aug 01 14:17:47.720311 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 486/956] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:47 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:48.743335 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8c7603d2-285a-4dd2-ade6-9ff9f67a7981 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:48.744255 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8c7603d2-285a-4dd2-ade6-9ff9f67a7981 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:48.747924 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:48.755019 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8c7603d2-285a-4dd2-ade6-9ff9f67a7981 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:48.755775 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8c7603d2-285a-4dd2-ade6-9ff9f67a7981 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:48.757143 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8c7603d2-285a-4dd2-ade6-9ff9f67a7981 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:48.757918 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8c7603d2-285a-4dd2-ade6-9ff9f67a7981 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:48.914648 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-8c7603d2-285a-4dd2-ade6-9ff9f67a7981 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:48.922780 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8c7603d2-285a-4dd2-ade6-9ff9f67a7981 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1556 microversion: 2.1 time: 0.184623 Aug 01 14:17:48.923358 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 471/957] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:48 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:48.943146 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-966ce92a-fe29-4bfb-bdb6-dfdcad318ca5 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:48.943736 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-966ce92a-fe29-4bfb-bdb6-dfdcad318ca5 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:48.946298 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:48.951913 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-966ce92a-fe29-4bfb-bdb6-dfdcad318ca5 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:48.952437 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-966ce92a-fe29-4bfb-bdb6-dfdcad318ca5 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:48.953218 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-966ce92a-fe29-4bfb-bdb6-dfdcad318ca5 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:48.953652 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-966ce92a-fe29-4bfb-bdb6-dfdcad318ca5 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:49.037153 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-966ce92a-fe29-4bfb-bdb6-dfdcad318ca5 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097832 Aug 01 14:17:49.037661 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 487/958] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 14:17:48 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:50.300918 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-4edcf5c8-88b8-4f35-b3ee-b22844f4e7d1 req-d69d2549-5b85-419c-9c8b-c148fe08657d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705cc9b9-fac2-4ec1-8137-d1993552b6a4", "tag": "3f82595f-922a-4da1-bb87-ffcee50a548a"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:50.316312 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-4edcf5c8-88b8-4f35-b3ee-b22844f4e7d1 req-d69d2549-5b85-419c-9c8b-c148fe08657d service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:50.316754 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-4edcf5c8-88b8-4f35-b3ee-b22844f4e7d1 req-d69d2549-5b85-419c-9c8b-c148fe08657d service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:50.329309 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-4edcf5c8-88b8-4f35-b3ee-b22844f4e7d1 req-d69d2549-5b85-419c-9c8b-c148fe08657d service nova] Creating event network-changed:3f82595f-922a-4da1-bb87-ffcee50a548a for instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 on hv-cinder-84517 Aug 01 14:17:50.334641 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-4edcf5c8-88b8-4f35-b3ee-b22844f4e7d1 req-d69d2549-5b85-419c-9c8b-c148fe08657d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037451 Aug 01 14:17:50.335191 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 472/959] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:26.385694 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:26.386491 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=61 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:26.392829 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9df5c183-5385-42f9-a68e-74c15a9f1e76 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:26.393455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9df5c183-5385-42f9-a68e-74c15a9f1e76 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:26.401490 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9df5c183-5385-42f9-a68e-74c15a9f1e76 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:26.402168 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9df5c183-5385-42f9-a68e-74c15a9f1e76 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:26.402746 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9df5c183-5385-42f9-a68e-74c15a9f1e76 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:26.403204 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9df5c183-5385-42f9-a68e-74c15a9f1e76 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:26.430275 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9df5c183-5385-42f9-a68e-74c15a9f1e76 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/ips" status: 200 len: 150 microversion: 2.1 time: 0.046010 Aug 01 14:18:26.430918 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 488/960] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:18:26 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:27.826061 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=3 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:27.827291 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=49 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:27.832036 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-aa8ece7c-2378-4a0e-aba2-6dcc0290560e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a63f9e8-6cb6-4b78-abe6-f0429a05553b"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:27.834653 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-aa8ece7c-2378-4a0e-aba2-6dcc0290560e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:27.842774 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-aa8ece7c-2378-4a0e-aba2-6dcc0290560e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.843213 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-aa8ece7c-2378-4a0e-aba2-6dcc0290560e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:27.843995 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-aa8ece7c-2378-4a0e-aba2-6dcc0290560e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.844460 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-aa8ece7c-2378-4a0e-aba2-6dcc0290560e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:28.421197 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-aa8ece7c-2378-4a0e-aba2-6dcc0290560e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.596551 Aug 01 14:18:28.422057 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 473/961] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:18:27 2022] POST /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments => generated 194 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:35.021536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a63f9e8-6cb6-4b78-abe6-f0429a05553b"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:35.023923 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:35.031811 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.032254 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.033092 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.033884 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.187984 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Invalid volume: volume 9a63f9e8-6cb6-4b78-abe6-f0429a05553b is already attached to instances: 705cc9b9-fac2-4ec1-8137-d1993552b6a4 Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: POST /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments HTTP/1.1 Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 74 Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:18:35.189759 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {"volumeAttachment": {"volumeId": "9a63f9e8-6cb6-4b78-abe6-f0429a05553b"}} Aug 01 14:18:35.192358 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Invalid volume: volume 9a63f9e8-6cb6-4b78-abe6-f0429a05553b is already attached to instances: 705cc9b9-fac2-4ec1-8137-d1993552b6a4 Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'server_id': '705cc9b9-fac2-4ec1-8137-d1993552b6a4', 'body': {'volumeAttachment': {'volumeId': '9a63f9e8-6cb6-4b78-abe6-f0429a05553b'}}} Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9a63f9e8-6cb6-4b78-abe6-f0429a05553b is already attached to instances: 705cc9b9-fac2-4ec1-8137-d1993552b6a4 Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:18:35.193738 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9a63f9e8-6cb6-4b78-abe6-f0429a05553b is already attached to instances: 705cc9b9-fac2-4ec1-8137-d1993552b6a4 Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:35.196196 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:35.198576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:35.198576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:18:35.198576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:18:35.198576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9a63f9e8-6cb6-4b78-abe6-f0429a05553b is already attached to instances: 705cc9b9-fac2-4ec1-8137-d1993552b6a4 Aug 01 14:18:35.198576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:18:35.198576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 400 to user: Invalid volume: volume 9a63f9e8-6cb6-4b78-abe6-f0429a05553b is already attached to instances: 705cc9b9-fac2-4ec1-8137-d1993552b6a4 {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:18:35.198576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7491bcad-173d-4bf9-a49f-7627a7222d5c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174211 Aug 01 14:18:35.198576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 489/962] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:18:35 2022] POST /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments => generated 174 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:18:35.268798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-22c7c1f8-31e6-45b5-969f-ab123608ee82 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:35.269433 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-22c7c1f8-31e6-45b5-969f-ab123608ee82 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:35.276982 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-22c7c1f8-31e6-45b5-969f-ab123608ee82 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.277348 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-22c7c1f8-31e6-45b5-969f-ab123608ee82 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.278110 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-22c7c1f8-31e6-45b5-969f-ab123608ee82 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.278544 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-22c7c1f8-31e6-45b5-969f-ab123608ee82 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.387225 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-22c7c1f8-31e6-45b5-969f-ab123608ee82 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lazy-loading 'services' on Instance uuid 705cc9b9-fac2-4ec1-8137-d1993552b6a4 {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:18:35.469980 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-22c7c1f8-31e6-45b5-969f-ab123608ee82 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments/9a63f9e8-6cb6-4b78-abe6-f0429a05553b" status: 202 len: 0 microversion: 2.1 time: 0.205658 Aug 01 14:18:35.470656 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 474/963] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:18:35 2022] DELETE /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments/9a63f9e8-6cb6-4b78-abe6-f0429a05553b => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:18:35.479862 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3186e82c-b57e-4f95-a8b8-2de390bcf1eb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:35.482888 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3186e82c-b57e-4f95-a8b8-2de390bcf1eb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:35.489589 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3186e82c-b57e-4f95-a8b8-2de390bcf1eb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.490040 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3186e82c-b57e-4f95-a8b8-2de390bcf1eb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.490837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3186e82c-b57e-4f95-a8b8-2de390bcf1eb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.491245 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3186e82c-b57e-4f95-a8b8-2de390bcf1eb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.525100 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3186e82c-b57e-4f95-a8b8-2de390bcf1eb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049719 Aug 01 14:18:35.525693 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 490/964] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:18:35 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:36.542841 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-581c1ea4-aba3-4118-91a6-d6a075314903 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:36.545406 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-581c1ea4-aba3-4118-91a6-d6a075314903 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:36.552447 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-581c1ea4-aba3-4118-91a6-d6a075314903 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.552909 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-581c1ea4-aba3-4118-91a6-d6a075314903 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.554091 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-581c1ea4-aba3-4118-91a6-d6a075314903 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.554533 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-581c1ea4-aba3-4118-91a6-d6a075314903 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.587948 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-581c1ea4-aba3-4118-91a6-d6a075314903 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050948 Aug 01 14:18:36.588554 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 475/965] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:18:36 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:18:36.655373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8f0f1020-269a-456c-a83c-0c4ff8cf74cb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:36.656013 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8f0f1020-269a-456c-a83c-0c4ff8cf74cb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:36.663632 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f0f1020-269a-456c-a83c-0c4ff8cf74cb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.664083 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f0f1020-269a-456c-a83c-0c4ff8cf74cb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.664895 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f0f1020-269a-456c-a83c-0c4ff8cf74cb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.665329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8f0f1020-269a-456c-a83c-0c4ff8cf74cb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.691844 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8f0f1020-269a-456c-a83c-0c4ff8cf74cb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:18:36.798271 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8f0f1020-269a-456c-a83c-0c4ff8cf74cb tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 204 len: 0 microversion: 2.1 time: 0.146560 Aug 01 14:18:36.799130 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 491/966] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:18:36 2022] DELETE /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:18:36.807997 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-cd0f4931-d2e6-4474-80c1-1bd0a1b57201 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:36.808635 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-cd0f4931-d2e6-4474-80c1-1bd0a1b57201 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:36.815143 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cd0f4931-d2e6-4474-80c1-1bd0a1b57201 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.815579 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cd0f4931-d2e6-4474-80c1-1bd0a1b57201 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.816375 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cd0f4931-d2e6-4474-80c1-1bd0a1b57201 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.816801 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cd0f4931-d2e6-4474-80c1-1bd0a1b57201 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.956122 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-cd0f4931-d2e6-4474-80c1-1bd0a1b57201 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:36.968551 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-cd0f4931-d2e6-4474-80c1-1bd0a1b57201 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1681 microversion: 2.1 time: 0.164374 Aug 01 14:18:36.969216 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 476/967] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:36 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:37.993618 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-494bc189-1cde-4dca-b3dd-8192bf91cd9b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:37.994302 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-494bc189-1cde-4dca-b3dd-8192bf91cd9b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:38.002050 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-494bc189-1cde-4dca-b3dd-8192bf91cd9b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.002502 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-494bc189-1cde-4dca-b3dd-8192bf91cd9b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.003294 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-494bc189-1cde-4dca-b3dd-8192bf91cd9b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.003729 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-494bc189-1cde-4dca-b3dd-8192bf91cd9b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.145456 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-494bc189-1cde-4dca-b3dd-8192bf91cd9b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:38.154424 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-494bc189-1cde-4dca-b3dd-8192bf91cd9b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1681 microversion: 2.1 time: 0.166518 Aug 01 14:18:38.155006 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 492/968] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:37 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:39.176639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f80f7062-bdc3-4c7b-a4b6-c2c01deeb6ee tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:39.177885 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-f80f7062-bdc3-4c7b-a4b6-c2c01deeb6ee tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:39.185485 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f80f7062-bdc3-4c7b-a4b6-c2c01deeb6ee tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:39.186113 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f80f7062-bdc3-4c7b-a4b6-c2c01deeb6ee tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:39.187171 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f80f7062-bdc3-4c7b-a4b6-c2c01deeb6ee tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:39.187545 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-f80f7062-bdc3-4c7b-a4b6-c2c01deeb6ee tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:39.423271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-f80f7062-bdc3-4c7b-a4b6-c2c01deeb6ee tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:39.431557 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f80f7062-bdc3-4c7b-a4b6-c2c01deeb6ee tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 200 len: 1681 microversion: 2.1 time: 0.258825 Aug 01 14:18:39.432378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 477/969] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:39 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:39.707366 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-cfaab3aa-d002-4800-b12f-cc94dea11cab req-1a05f000-c5cd-4a27-89e5-a813a774c503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705cc9b9-fac2-4ec1-8137-d1993552b6a4", "name": "network-vif-deleted", "tag": "3f82595f-922a-4da1-bb87-ffcee50a548a"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:39.725540 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-cfaab3aa-d002-4800-b12f-cc94dea11cab req-1a05f000-c5cd-4a27-89e5-a813a774c503 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:39.725985 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-cfaab3aa-d002-4800-b12f-cc94dea11cab req-1a05f000-c5cd-4a27-89e5-a813a774c503 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:39.739276 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-cfaab3aa-d002-4800-b12f-cc94dea11cab req-1a05f000-c5cd-4a27-89e5-a813a774c503 service nova] Creating event network-vif-deleted:3f82595f-922a-4da1-bb87-ffcee50a548a for instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 on hv-cinder-84517 Aug 01 14:18:39.744362 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-cfaab3aa-d002-4800-b12f-cc94dea11cab req-1a05f000-c5cd-4a27-89e5-a813a774c503 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040777 Aug 01 14:18:39.744932 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 493/970] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:40.169547 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:18:40.169771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Mon Aug 1 14:18:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:18:40.453684 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:40.454656 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:40.461505 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.462044 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.462893 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.463323 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.478177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 HTTP/1.1 Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:18:40.479905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:18:40.481570 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '705cc9b9-fac2-4ec1-8137-d1993552b6a4'} Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:18:40.482376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:18:40.483591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.485989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:18:40.485989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bce6ec71-0ce0-4a7b-a26b-d84e22a67183 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 404 len: 111 microversion: 2.1 time: 0.031669 Aug 01 14:18:40.485989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 478/971] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:40 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:18:40.491705 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-668dad0c-1476-4213-b542-e28399e29b73 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '.version_select at 0x7fc5796b4310>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:40.516610 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-668dad0c-1476-4213-b542-e28399e29b73 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647152098" status: 202 len: 0 microversion: 2.1 time: 0.029094 Aug 01 14:18:40.517188 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 494/972] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 14:18:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647152098 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:18:41.198323 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d316a3e2-524e-4068-9f63-9bb4f348a80c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: .version_select at 0x7fc57a056a60>, body: {"keypair": {"name": "tempest-keypair-1647228630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGBgtPGygzGNffNy6CvmyCdABa6nl6yzaTDh/Qu+KYGzzpeXJtDmIcVQyJ4IPXuMFmQFxN/XAYHM6MC8FUYLwIxY1GzYxa2M+kIT6nlqVTKpJQv5msoNlLg+0vu3TPr2g=="}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:41.214280 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-d316a3e2-524e-4068-9f63-9bb4f348a80c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for project db87d8b3358945aa88acbdc4246917ae. Resources: {'key_pairs'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:18:41.220241 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.quota [None req-d316a3e2-524e-4068-9f63-9bb4f348a80c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for user a9fc33bdca304c33b6a78122a54f492a and project db87d8b3358945aa88acbdc4246917ae. Resources: {'key_pairs'} {{(pid=118110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:18:41.245968 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d316a3e2-524e-4068-9f63-9bb4f348a80c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051517 Aug 01 14:18:41.246650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 479/973] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 14:18:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:42.746837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1180063160", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1987c22e-ab83-4108-bc22-29b9909b71a1"}], "security_groups": [{"name": "tempest-securitygroup--387874666"}], "key_name": "tempest-keypair-1647228630", "user_data": "}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:42.869708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] validate_networks() for [('1987c22e-ab83-4108-bc22-29b9909b71a1', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:18:43.346079 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:18:43.346566 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:18:43.347043 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:18:43.347455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:18:43.347865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:18:43.358167 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.358620 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.359432 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.359907 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.379771 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for project db87d8b3358945aa88acbdc4246917ae. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:18:43.384766 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Getting quotas for user a9fc33bdca304c33b6a78122a54f492a and project db87d8b3358945aa88acbdc4246917ae. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:18:43.397460 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:18:43.400052 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:18:43.455837 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a864f2d4-15c3-4112-905b-2ee622caff09 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715315 Aug 01 14:18:43.456637 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 495/974] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:18:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:18:43.477284 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-85f5ed53-f4a1-4763-aa42-e95a89b3f99b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:43.478350 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-85f5ed53-f4a1-4763-aa42-e95a89b3f99b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:43.539649 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-85f5ed53-f4a1-4763-aa42-e95a89b3f99b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:43.549613 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-85f5ed53-f4a1-4763-aa42-e95a89b3f99b tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1242 microversion: 2.1 time: 0.083185 Aug 01 14:18:43.550279 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 480/975] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:43 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:44.571791 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bfe73cf3-bd5f-49d3-9614-1ab9595b67da tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:44.572477 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bfe73cf3-bd5f-49d3-9614-1ab9595b67da tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:44.579710 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfe73cf3-bd5f-49d3-9614-1ab9595b67da tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:44.580290 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfe73cf3-bd5f-49d3-9614-1ab9595b67da tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:44.581201 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfe73cf3-bd5f-49d3-9614-1ab9595b67da tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:44.581691 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfe73cf3-bd5f-49d3-9614-1ab9595b67da tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:44.658127 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bfe73cf3-bd5f-49d3-9614-1ab9595b67da tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:44.666261 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bfe73cf3-bd5f-49d3-9614-1ab9595b67da tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1300 microversion: 2.1 time: 0.099033 Aug 01 14:18:44.666827 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 496/976] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:44 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:45.687851 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2baef88c-8e90-43b2-bb6b-6255962c4e8e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:45.688522 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2baef88c-8e90-43b2-bb6b-6255962c4e8e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:45.695513 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2baef88c-8e90-43b2-bb6b-6255962c4e8e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:45.695960 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2baef88c-8e90-43b2-bb6b-6255962c4e8e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.696788 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2baef88c-8e90-43b2-bb6b-6255962c4e8e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:45.697220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2baef88c-8e90-43b2-bb6b-6255962c4e8e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.916791 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-2baef88c-8e90-43b2-bb6b-6255962c4e8e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:45.924639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2baef88c-8e90-43b2-bb6b-6255962c4e8e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1367 microversion: 2.1 time: 0.241150 Aug 01 14:18:45.925223 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 481/977] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:45 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:46.006976 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-4c984b44-edc7-40ac-ae64-2dd186f63f9f req-602b4533-3218-4e53-b285-b0177120fd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6cdfa01-7170-497f-bdfa-a6e5d95e4007", "tag": "635a99d2-0a61-4a73-a3d0-fdf636d39a2f"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:46.021089 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4c984b44-edc7-40ac-ae64-2dd186f63f9f req-602b4533-3218-4e53-b285-b0177120fd45 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.021789 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4c984b44-edc7-40ac-ae64-2dd186f63f9f req-602b4533-3218-4e53-b285-b0177120fd45 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.037129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-4c984b44-edc7-40ac-ae64-2dd186f63f9f req-602b4533-3218-4e53-b285-b0177120fd45 service nova] Creating event network-changed:635a99d2-0a61-4a73-a3d0-fdf636d39a2f for instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 on hv-cinder-84517 Aug 01 14:18:46.043047 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-4c984b44-edc7-40ac-ae64-2dd186f63f9f req-602b4533-3218-4e53-b285-b0177120fd45 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040463 Aug 01 14:18:46.043713 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 497/978] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:46.946093 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ded5a129-c26b-49db-9d1d-9a77c0052218 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:46.946757 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ded5a129-c26b-49db-9d1d-9a77c0052218 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:46.953864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ded5a129-c26b-49db-9d1d-9a77c0052218 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.954315 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ded5a129-c26b-49db-9d1d-9a77c0052218 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.955101 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ded5a129-c26b-49db-9d1d-9a77c0052218 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.955541 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ded5a129-c26b-49db-9d1d-9a77c0052218 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.107434 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ded5a129-c26b-49db-9d1d-9a77c0052218 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:47.116201 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ded5a129-c26b-49db-9d1d-9a77c0052218 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1367 microversion: 2.1 time: 0.174023 Aug 01 14:18:47.116842 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 482/979] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:46 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:48.140852 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9670dbec-41f7-48a2-8a10-f983474573dc tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:48.141623 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9670dbec-41f7-48a2-8a10-f983474573dc tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:48.148967 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9670dbec-41f7-48a2-8a10-f983474573dc tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:48.149632 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9670dbec-41f7-48a2-8a10-f983474573dc tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:48.150548 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9670dbec-41f7-48a2-8a10-f983474573dc tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:48.151150 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9670dbec-41f7-48a2-8a10-f983474573dc tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:48.326264 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9670dbec-41f7-48a2-8a10-f983474573dc tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:48.334916 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9670dbec-41f7-48a2-8a10-f983474573dc tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1367 microversion: 2.1 time: 0.199209 Aug 01 14:18:48.335532 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 498/980] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:48 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:49.359004 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-496fb0a8-219f-436f-af4e-3fa41e14aa43 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:49.359919 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-496fb0a8-219f-436f-af4e-3fa41e14aa43 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:49.367483 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-496fb0a8-219f-436f-af4e-3fa41e14aa43 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.367989 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-496fb0a8-219f-436f-af4e-3fa41e14aa43 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.368852 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-496fb0a8-219f-436f-af4e-3fa41e14aa43 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.369282 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-496fb0a8-219f-436f-af4e-3fa41e14aa43 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.520194 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-496fb0a8-219f-436f-af4e-3fa41e14aa43 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:49.528246 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-496fb0a8-219f-436f-af4e-3fa41e14aa43 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1367 microversion: 2.1 time: 0.175026 Aug 01 14:18:49.528845 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 483/981] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:49 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:50.551782 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c5e50bb7-d52c-427b-bbda-75d4fffc21df tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:50.552430 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c5e50bb7-d52c-427b-bbda-75d4fffc21df tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:50.560099 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5e50bb7-d52c-427b-bbda-75d4fffc21df tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:50.560784 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5e50bb7-d52c-427b-bbda-75d4fffc21df tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:50.561630 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5e50bb7-d52c-427b-bbda-75d4fffc21df tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:50.562065 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5e50bb7-d52c-427b-bbda-75d4fffc21df tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:50.730794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c5e50bb7-d52c-427b-bbda-75d4fffc21df tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:50.738713 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c5e50bb7-d52c-427b-bbda-75d4fffc21df tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1367 microversion: 2.1 time: 0.190753 Aug 01 14:18:50.739314 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 499/982] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:50 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:51.606146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-1018cb0a-a9c8-4e9a-b8d2-918b6517eb65 req-2878a84f-3e6a-4306-b3a4-b4cdd806e705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6cdfa01-7170-497f-bdfa-a6e5d95e4007", "name": "network-vif-plugged", "status": "completed", "tag": "635a99d2-0a61-4a73-a3d0-fdf636d39a2f"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:51.618296 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-1018cb0a-a9c8-4e9a-b8d2-918b6517eb65 req-2878a84f-3e6a-4306-b3a4-b4cdd806e705 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.618737 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-1018cb0a-a9c8-4e9a-b8d2-918b6517eb65 req-2878a84f-3e6a-4306-b3a4-b4cdd806e705 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.631204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-1018cb0a-a9c8-4e9a-b8d2-918b6517eb65 req-2878a84f-3e6a-4306-b3a4-b4cdd806e705 service nova] Creating event network-vif-plugged:635a99d2-0a61-4a73-a3d0-fdf636d39a2f for instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 on hv-cinder-84517 Aug 01 14:18:51.636549 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-1018cb0a-a9c8-4e9a-b8d2-918b6517eb65 req-2878a84f-3e6a-4306-b3a4-b4cdd806e705 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034419 Aug 01 14:18:51.637359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 484/983] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:51.760598 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fed06165-5357-4946-9e7a-12d6810744c3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:51.761218 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fed06165-5357-4946-9e7a-12d6810744c3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:51.768962 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fed06165-5357-4946-9e7a-12d6810744c3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.769413 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fed06165-5357-4946-9e7a-12d6810744c3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.770211 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fed06165-5357-4946-9e7a-12d6810744c3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.770647 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fed06165-5357-4946-9e7a-12d6810744c3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.954998 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fed06165-5357-4946-9e7a-12d6810744c3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:51.963614 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fed06165-5357-4946-9e7a-12d6810744c3 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1367 microversion: 2.1 time: 0.207159 Aug 01 14:18:51.964110 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 500/984] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:51 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:52.989573 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-9ca21b28-6480-412f-a195-d6cddeefdfab tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:52.990295 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-9ca21b28-6480-412f-a195-d6cddeefdfab tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:52.997297 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9ca21b28-6480-412f-a195-d6cddeefdfab tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.997738 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9ca21b28-6480-412f-a195-d6cddeefdfab tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:52.998523 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9ca21b28-6480-412f-a195-d6cddeefdfab tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.998937 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-9ca21b28-6480-412f-a195-d6cddeefdfab tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:53.136313 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-9ca21b28-6480-412f-a195-d6cddeefdfab tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:53.146944 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-9ca21b28-6480-412f-a195-d6cddeefdfab tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1367 microversion: 2.1 time: 0.161864 Aug 01 14:18:53.147776 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 485/985] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:52 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:54.169095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8d96c6d8-de57-4770-9f7d-dd227d74d17a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:54.169801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8d96c6d8-de57-4770-9f7d-dd227d74d17a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:54.171926 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:54.172616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:54.179486 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d96c6d8-de57-4770-9f7d-dd227d74d17a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:54.180217 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d96c6d8-de57-4770-9f7d-dd227d74d17a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:54.181103 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d96c6d8-de57-4770-9f7d-dd227d74d17a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:54.181540 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d96c6d8-de57-4770-9f7d-dd227d74d17a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:54.328260 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8d96c6d8-de57-4770-9f7d-dd227d74d17a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:54.336576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8d96c6d8-de57-4770-9f7d-dd227d74d17a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1558 microversion: 2.1 time: 0.171509 Aug 01 14:18:54.337160 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 501/986] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:54 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:54.357768 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-2406ae21-744f-4bf2-b4ed-f142d2b403dd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:54.358347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-2406ae21-744f-4bf2-b4ed-f142d2b403dd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:54.360239 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=6 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:54.366492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2406ae21-744f-4bf2-b4ed-f142d2b403dd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:54.366927 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2406ae21-744f-4bf2-b4ed-f142d2b403dd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:54.367745 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2406ae21-744f-4bf2-b4ed-f142d2b403dd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:54.368169 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-2406ae21-744f-4bf2-b4ed-f142d2b403dd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:54.451654 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-2406ae21-744f-4bf2-b4ed-f142d2b403dd tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097739 Aug 01 14:18:54.452262 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 486/987] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 14:18:54 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:55.776615 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-84c868a3-88ca-41a9-a263-afa7c3a3d704 req-ee9211a6-5f20-48e7-b792-55cda9ca4c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6cdfa01-7170-497f-bdfa-a6e5d95e4007", "tag": "635a99d2-0a61-4a73-a3d0-fdf636d39a2f"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:55.787386 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-84c868a3-88ca-41a9-a263-afa7c3a3d704 req-ee9211a6-5f20-48e7-b792-55cda9ca4c49 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.787827 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-84c868a3-88ca-41a9-a263-afa7c3a3d704 req-ee9211a6-5f20-48e7-b792-55cda9ca4c49 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.800347 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-84c868a3-88ca-41a9-a263-afa7c3a3d704 req-ee9211a6-5f20-48e7-b792-55cda9ca4c49 service nova] Creating event network-changed:635a99d2-0a61-4a73-a3d0-fdf636d39a2f for instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 on hv-cinder-84517 Aug 01 14:18:55.805593 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-84c868a3-88ca-41a9-a263-afa7c3a3d704 req-ee9211a6-5f20-48e7-b792-55cda9ca4c49 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033075 Aug 01 14:18:55.806324 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 502/988] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:19:16.986339 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:16.987849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:16.993014 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-127afe1a-e430-4ae8-94a8-54c5f0f8608f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:16.993518 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-127afe1a-e430-4ae8-94a8-54c5f0f8608f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:16.995104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:16.996493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:17.002243 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-127afe1a-e430-4ae8-94a8-54c5f0f8608f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:17.002731 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-127afe1a-e430-4ae8-94a8-54c5f0f8608f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:17.003492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-127afe1a-e430-4ae8-94a8-54c5f0f8608f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:17.004293 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-127afe1a-e430-4ae8-94a8-54c5f0f8608f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:17.035933 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-127afe1a-e430-4ae8-94a8-54c5f0f8608f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:19:17.075765 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-4aaf1323-02e1-410c-8d59-75a0ecbd01e8 req-b3df35d0-3453-4c62-9bac-47f237957bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c15868-3e72-4d3f-9b87-00f3d51127c4", "tag": "2945d68d-3b91-4d52-b13b-c25098ca3225"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:17.087042 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4aaf1323-02e1-410c-8d59-75a0ecbd01e8 req-b3df35d0-3453-4c62-9bac-47f237957bda service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:17.087591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4aaf1323-02e1-410c-8d59-75a0ecbd01e8 req-b3df35d0-3453-4c62-9bac-47f237957bda service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:17.100440 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-4aaf1323-02e1-410c-8d59-75a0ecbd01e8 req-b3df35d0-3453-4c62-9bac-47f237957bda service nova] Creating event network-changed:2945d68d-3b91-4d52-b13b-c25098ca3225 for instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 on hv-cinder-84517 Aug 01 14:19:17.107932 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-4aaf1323-02e1-410c-8d59-75a0ecbd01e8 req-b3df35d0-3453-4c62-9bac-47f237957bda service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118226 Aug 01 14:19:17.108992 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 503/989] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:19:17.137998 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-127afe1a-e430-4ae8-94a8-54c5f0f8608f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 204 len: 0 microversion: 2.1 time: 0.152489 Aug 01 14:19:17.142119 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 487/990] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:19:16 2022] DELETE /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:19:17.153884 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6edbcf2a-0ea6-4b09-a99d-03f59623e4b0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:17.154604 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6edbcf2a-0ea6-4b09-a99d-03f59623e4b0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:17.163063 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6edbcf2a-0ea6-4b09-a99d-03f59623e4b0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:17.163855 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6edbcf2a-0ea6-4b09-a99d-03f59623e4b0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:17.164671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6edbcf2a-0ea6-4b09-a99d-03f59623e4b0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:17.165527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6edbcf2a-0ea6-4b09-a99d-03f59623e4b0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:17.322728 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6edbcf2a-0ea6-4b09-a99d-03f59623e4b0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:17.330777 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6edbcf2a-0ea6-4b09-a99d-03f59623e4b0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1575 microversion: 2.1 time: 0.186949 Aug 01 14:19:17.331379 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 504/991] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:17 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:18.353228 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ffdedf8d-b8fe-4f61-909d-4812843f460e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:18.353816 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ffdedf8d-b8fe-4f61-909d-4812843f460e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:18.360982 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ffdedf8d-b8fe-4f61-909d-4812843f460e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:18.361423 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ffdedf8d-b8fe-4f61-909d-4812843f460e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:18.362200 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ffdedf8d-b8fe-4f61-909d-4812843f460e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:18.362625 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ffdedf8d-b8fe-4f61-909d-4812843f460e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:18.573981 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-ffdedf8d-b8fe-4f61-909d-4812843f460e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:18.587487 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ffdedf8d-b8fe-4f61-909d-4812843f460e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1575 microversion: 2.1 time: 0.238615 Aug 01 14:19:18.588379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 488/992] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:18 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:19.336110 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-69c7f8f4-b2ef-426c-ac84-23164368f2a2 req-48756cac-5361-4824-a85b-4c6fc68fa339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c15868-3e72-4d3f-9b87-00f3d51127c4", "name": "network-vif-deleted", "tag": "2945d68d-3b91-4d52-b13b-c25098ca3225"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:19.348786 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-69c7f8f4-b2ef-426c-ac84-23164368f2a2 req-48756cac-5361-4824-a85b-4c6fc68fa339 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:19.349231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-69c7f8f4-b2ef-426c-ac84-23164368f2a2 req-48756cac-5361-4824-a85b-4c6fc68fa339 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:19.361294 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-69c7f8f4-b2ef-426c-ac84-23164368f2a2 req-48756cac-5361-4824-a85b-4c6fc68fa339 service nova] Creating event network-vif-deleted:2945d68d-3b91-4d52-b13b-c25098ca3225 for instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 on hv-cinder-84517 Aug 01 14:19:19.366726 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-69c7f8f4-b2ef-426c-ac84-23164368f2a2 req-48756cac-5361-4824-a85b-4c6fc68fa339 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035727 Aug 01 14:19:19.368494 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 505/993] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:19:19.610924 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1beaa9a2-28c1-4021-96fc-3160ee32556a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:19.611544 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1beaa9a2-28c1-4021-96fc-3160ee32556a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:19.618108 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1beaa9a2-28c1-4021-96fc-3160ee32556a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:19.618533 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1beaa9a2-28c1-4021-96fc-3160ee32556a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:19.619352 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1beaa9a2-28c1-4021-96fc-3160ee32556a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:19.620191 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1beaa9a2-28c1-4021-96fc-3160ee32556a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:19.683907 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1beaa9a2-28c1-4021-96fc-3160ee32556a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:19.692429 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1beaa9a2-28c1-4021-96fc-3160ee32556a tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 200 len: 1225 microversion: 2.1 time: 0.085407 Aug 01 14:19:19.693019 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 489/994] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:19 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:20.714840 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:20.715535 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 92c15868-3e72-4d3f-9b87-00f3d51127c4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:20.722028 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:20.722474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:20.723239 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:20.723636 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:20.737520 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] HTTP exception thrown: Instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 could not be found. Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Request method failure captured: Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 HTTP/1.1 Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi597n5rVzsOyGwg0nDBP13SlzfdQVenXJfrdspuRNAs1-4IfgQR81LS92QquvZgt9VglSMGjnu0mlpEZdBZHeBmFYwQay0a1zB9e0aWWsO2_wf1py2OWmcetwcV-UkmQ6cnH4BjDmMHjorqSL5VaivPV1zKWlJX1T6qyEp1SUQLw4n30 Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:19:20.739136 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f0a6c07d69ef4cf4a545f48e7079044d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f0a6c07d69ef4cf4a545f48e7079044d"}]}] Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 8e30910692b4474092f1585a671e2f41 Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 could not be found. Aug 01 14:19:20.740807 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '92c15868-3e72-4d3f-9b87-00f3d51127c4'} Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 could not be found. Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:20.741798 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 could not be found. Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 could not be found. Aug 01 14:19:20.743368 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:20.744878 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Returning 404 to user: Instance 92c15868-3e72-4d3f-9b87-00f3d51127c4 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:20.744878 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0db992bf-834f-4d3d-9d2c-9034a98baef6 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4" status: 404 len: 111 microversion: 2.1 time: 0.030594 Aug 01 14:19:20.744878 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 506/995] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:20 2022] GET /compute/v2.1/servers/92c15868-3e72-4d3f-9b87-00f3d51127c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:23.924724 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-8582fd1f-193c-42e4-bcee-7d2245821fa7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:23.925818 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8582fd1f-193c-42e4-bcee-7d2245821fa7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:23.933942 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8582fd1f-193c-42e4-bcee-7d2245821fa7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:23.934411 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8582fd1f-193c-42e4-bcee-7d2245821fa7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:23.935151 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8582fd1f-193c-42e4-bcee-7d2245821fa7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:23.935612 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-8582fd1f-193c-42e4-bcee-7d2245821fa7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:23.965684 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-8582fd1f-193c-42e4-bcee-7d2245821fa7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:19:23.990910 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-3276af87-a69a-48cd-850e-7ddacd6f3825 req-255f6da7-5c06-40a9-a8fa-7d817f1b3377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1842e4-dc37-4e0d-b172-23f29125f8d0", "tag": "b550f9ea-8012-4b81-8b79-2ea6bb8e8012"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:24.001316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-3276af87-a69a-48cd-850e-7ddacd6f3825 req-255f6da7-5c06-40a9-a8fa-7d817f1b3377 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:24.001757 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-3276af87-a69a-48cd-850e-7ddacd6f3825 req-255f6da7-5c06-40a9-a8fa-7d817f1b3377 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:24.016481 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-3276af87-a69a-48cd-850e-7ddacd6f3825 req-255f6da7-5c06-40a9-a8fa-7d817f1b3377 service nova] Creating event network-changed:b550f9ea-8012-4b81-8b79-2ea6bb8e8012 for instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 on hv-cinder-84517 Aug 01 14:19:24.019791 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-3276af87-a69a-48cd-850e-7ddacd6f3825 req-255f6da7-5c06-40a9-a8fa-7d817f1b3377 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103826 Aug 01 14:19:24.020897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 507/996] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:19:24.107197 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-8582fd1f-193c-42e4-bcee-7d2245821fa7 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 204 len: 0 microversion: 2.1 time: 0.192880 Aug 01 14:19:24.108199 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 490/997] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:19:23 2022] DELETE /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:19:24.120436 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8990f0e8-4bea-43e2-982e-7f1a32749320 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:24.121195 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8990f0e8-4bea-43e2-982e-7f1a32749320 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:24.128484 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8990f0e8-4bea-43e2-982e-7f1a32749320 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:24.128928 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8990f0e8-4bea-43e2-982e-7f1a32749320 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:24.129703 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8990f0e8-4bea-43e2-982e-7f1a32749320 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:24.130133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8990f0e8-4bea-43e2-982e-7f1a32749320 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:24.287814 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8990f0e8-4bea-43e2-982e-7f1a32749320 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:24.296864 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8990f0e8-4bea-43e2-982e-7f1a32749320 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1578 microversion: 2.1 time: 0.181145 Aug 01 14:19:24.297469 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 508/998] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:24 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:25.320056 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-99d529d8-1c54-49de-a5af-7a464309f25b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:25.320795 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-99d529d8-1c54-49de-a5af-7a464309f25b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:25.329355 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d529d8-1c54-49de-a5af-7a464309f25b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.329703 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d529d8-1c54-49de-a5af-7a464309f25b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.330529 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d529d8-1c54-49de-a5af-7a464309f25b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.330988 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-99d529d8-1c54-49de-a5af-7a464309f25b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.549773 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-99d529d8-1c54-49de-a5af-7a464309f25b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:25.559179 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-99d529d8-1c54-49de-a5af-7a464309f25b tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1578 microversion: 2.1 time: 0.243403 Aug 01 14:19:25.559775 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 491/999] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:25 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1578 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:26.318962 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-4d09bcc8-7900-4c80-96ff-afddf930ccd8 req-fdf7072e-74c9-492c-ad92-f284e8cbf6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1842e4-dc37-4e0d-b172-23f29125f8d0", "name": "network-vif-deleted", "tag": "b550f9ea-8012-4b81-8b79-2ea6bb8e8012"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:26.330639 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4d09bcc8-7900-4c80-96ff-afddf930ccd8 req-fdf7072e-74c9-492c-ad92-f284e8cbf6a5 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.331140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4d09bcc8-7900-4c80-96ff-afddf930ccd8 req-fdf7072e-74c9-492c-ad92-f284e8cbf6a5 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.343500 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-4d09bcc8-7900-4c80-96ff-afddf930ccd8 req-fdf7072e-74c9-492c-ad92-f284e8cbf6a5 service nova] Creating event network-vif-deleted:b550f9ea-8012-4b81-8b79-2ea6bb8e8012 for instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 on hv-cinder-84517 Aug 01 14:19:26.348862 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-4d09bcc8-7900-4c80-96ff-afddf930ccd8 req-fdf7072e-74c9-492c-ad92-f284e8cbf6a5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033635 Aug 01 14:19:26.349593 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 509/1000] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:19:26.585389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:26.587916 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:26.601420 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.602200 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.603594 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.604691 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.661866 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.662311 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.662768 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lazy-loading 'fault' on Instance uuid 7d1842e4-dc37-4e0d-b172-23f29125f8d0 {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:19:26.710960 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e30910692b4474092f1585a671e2f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a6c07d69ef4cf4a545f48e7079044d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:26.720130 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-cca39db8-54df-4a7b-b411-3a98cb0815d0 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 200 len: 1230 microversion: 2.1 time: 0.142370 Aug 01 14:19:26.720786 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 492/1001] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:26 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 1230 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:27.746839 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:27.747781 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 7d1842e4-dc37-4e0d-b172-23f29125f8d0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:27.757746 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:27.758173 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:27.758966 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:27.759398 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:27.773751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] HTTP exception thrown: Instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 could not be found. Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Request method failure captured: Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 HTTP/1.1 Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi597n5rVzsOyGwg0nDBP13SlzfdQVenXJfrdspuRNAs1-4IfgQR81LS92QquvZgt9VglSMGjnu0mlpEZdBZHeBmFYwQay0a1zB9e0aWWsO2_wf1py2OWmcetwcV-UkmQ6cnH4BjDmMHjorqSL5VaivPV1zKWlJX1T6qyEp1SUQLw4n30 Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:19:27.775527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f0a6c07d69ef4cf4a545f48e7079044d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f0a6c07d69ef4cf4a545f48e7079044d"}]}] Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 8e30910692b4474092f1585a671e2f41 Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 could not be found. Aug 01 14:19:27.777257 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '7d1842e4-dc37-4e0d-b172-23f29125f8d0'} Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 could not be found. Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:27.778031 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 could not be found. Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 could not be found. Aug 01 14:19:27.779253 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:27.780618 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Returning 404 to user: Instance 7d1842e4-dc37-4e0d-b172-23f29125f8d0 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:27.780618 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4c99d9a9-15c8-4d34-a350-deda66bce10e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0" status: 404 len: 111 microversion: 2.1 time: 0.035555 Aug 01 14:19:27.780618 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 510/1002] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:27 2022] GET /compute/v2.1/servers/7d1842e4-dc37-4e0d-b172-23f29125f8d0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:28.256650 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:28.257343 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:28.264720 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:28.265168 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:28.265947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:28.266379 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:28.281494 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] HTTP exception thrown: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Request method failure captured: Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: DELETE /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 HTTP/1.1 Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi597n5rVzsOyGwg0nDBP13SlzfdQVenXJfrdspuRNAs1-4IfgQR81LS92QquvZgt9VglSMGjnu0mlpEZdBZHeBmFYwQay0a1zB9e0aWWsO2_wf1py2OWmcetwcV-UkmQ6cnH4BjDmMHjorqSL5VaivPV1zKWlJX1T6qyEp1SUQLw4n30 Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:19:28.283592 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f0a6c07d69ef4cf4a545f48e7079044d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f0a6c07d69ef4cf4a545f48e7079044d"}]}] Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 8e30910692b4474092f1585a671e2f41 Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.286277 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '0d7f31f9-adc0-4be6-92b9-0c2c99e14308'} Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:28.287807 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.290307 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.293497 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Returning 404 to user: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:28.293497 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0864e0b6-c731-41e6-b5d4-7436e2f98b1e tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 404 len: 111 microversion: 2.1 time: 0.033160 Aug 01 14:19:28.293497 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 493/1003] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:19:28 2022] DELETE /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:28.298238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:28.298929 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] [instance: 0d7f31f9-adc0-4be6-92b9-0c2c99e14308] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:28.305412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:28.305794 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:28.306565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:28.307139 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:28.323602 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] HTTP exception thrown: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Request method failure captured: Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 HTTP/1.1 Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi597n5rVzsOyGwg0nDBP13SlzfdQVenXJfrdspuRNAs1-4IfgQR81LS92QquvZgt9VglSMGjnu0mlpEZdBZHeBmFYwQay0a1zB9e0aWWsO2_wf1py2OWmcetwcV-UkmQ6cnH4BjDmMHjorqSL5VaivPV1zKWlJX1T6qyEp1SUQLw4n30 Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:19:28.325068 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f0a6c07d69ef4cf4a545f48e7079044d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f0a6c07d69ef4cf4a545f48e7079044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f0a6c07d69ef4cf4a545f48e7079044d"}]}] Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: f0a6c07d69ef4cf4a545f48e7079044d Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-TestVolumeBootPattern-736803602 Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: 8e30910692b4474092f1585a671e2f41 Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-TestVolumeBootPattern-736803602-project Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.327423 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '0d7f31f9-adc0-4be6-92b9-0c2c99e14308'} Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:28.328492 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. Aug 01 14:19:28.330259 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:28.331558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Returning 404 to user: Instance 0d7f31f9-adc0-4be6-92b9-0c2c99e14308 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:28.331558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9dca6bef-a676-4e14-b6a3-6b958aa66bd4 tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308" status: 404 len: 111 microversion: 2.1 time: 0.033231 Aug 01 14:19:28.331558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 511/1004] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:28 2022] GET /compute/v2.1/servers/0d7f31f9-adc0-4be6-92b9-0c2c99e14308 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:29.656537 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1a02ec5d-e3f6-47cf-b80d-4bf7fa0e513f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] Calling method '.version_select at 0x7fc57a244280>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:29.679778 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1a02ec5d-e3f6-47cf-b80d-4bf7fa0e513f tempest-TestVolumeBootPattern-736803602 tempest-TestVolumeBootPattern-736803602-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-923806228" status: 202 len: 0 microversion: 2.1 time: 0.027163 Aug 01 14:19:29.680703 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 494/1005] 10.222.0.45 () {58 vars in 1260 bytes} [Mon Aug 1 14:19:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-923806228 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:19:31.654375 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3bdd9215-4e9e-4d36-8010-bba9dedd0692 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:31.654937 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3bdd9215-4e9e-4d36-8010-bba9dedd0692 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:31.662329 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3bdd9215-4e9e-4d36-8010-bba9dedd0692 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:31.662788 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3bdd9215-4e9e-4d36-8010-bba9dedd0692 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:31.663662 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3bdd9215-4e9e-4d36-8010-bba9dedd0692 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:31.667385 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3bdd9215-4e9e-4d36-8010-bba9dedd0692 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:31.707286 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3bdd9215-4e9e-4d36-8010-bba9dedd0692 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/ips" status: 200 len: 151 microversion: 2.1 time: 0.057365 Aug 01 14:19:31.708511 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 512/1006] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 14:19:31 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/ips => generated 151 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:19:33.133180 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-16f90d10-52c9-418a-8cc2-03b2dd012d90 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b792a6e-5504-44bd-9a3a-d4ed2177c942"}} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:33.136152 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-16f90d10-52c9-418a-8cc2-03b2dd012d90 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:33.143903 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-16f90d10-52c9-418a-8cc2-03b2dd012d90 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:33.144937 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-16f90d10-52c9-418a-8cc2-03b2dd012d90 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:33.146216 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-16f90d10-52c9-418a-8cc2-03b2dd012d90 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:33.147390 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-16f90d10-52c9-418a-8cc2-03b2dd012d90 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:33.546591 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-16f90d10-52c9-418a-8cc2-03b2dd012d90 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "POST /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417740 Aug 01 14:19:33.547821 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 495/1007] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:19:33 2022] POST /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:19:40.260348 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b416c482-ab14-44dc-b2b2-e8ac7ca69ed9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:40.261304 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b416c482-ab14-44dc-b2b2-e8ac7ca69ed9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:40.268851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b416c482-ab14-44dc-b2b2-e8ac7ca69ed9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:40.269301 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b416c482-ab14-44dc-b2b2-e8ac7ca69ed9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:40.270095 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b416c482-ab14-44dc-b2b2-e8ac7ca69ed9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:40.270538 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b416c482-ab14-44dc-b2b2-e8ac7ca69ed9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:40.362865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-b416c482-ab14-44dc-b2b2-e8ac7ca69ed9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lazy-loading 'services' on Instance uuid f6cdfa01-7170-497f-bdfa-a6e5d95e4007 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:19:40.443833 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b416c482-ab14-44dc-b2b2-e8ac7ca69ed9 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-volume_attachments/0b792a6e-5504-44bd-9a3a-d4ed2177c942" status: 202 len: 0 microversion: 2.1 time: 0.188154 Aug 01 14:19:40.444755 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 513/1008] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:19:40 2022] DELETE /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-volume_attachments/0b792a6e-5504-44bd-9a3a-d4ed2177c942 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:19:40.455848 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5e179b8f-69bf-4446-8460-8180eaa7a08a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:40.458338 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5e179b8f-69bf-4446-8460-8180eaa7a08a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:40.465711 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e179b8f-69bf-4446-8460-8180eaa7a08a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:40.466159 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e179b8f-69bf-4446-8460-8180eaa7a08a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:40.466960 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e179b8f-69bf-4446-8460-8180eaa7a08a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:40.467396 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5e179b8f-69bf-4446-8460-8180eaa7a08a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:40.501230 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5e179b8f-69bf-4446-8460-8180eaa7a08a tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051185 Aug 01 14:19:40.507014 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 496/1009] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:19:40 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:19:41.518497 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d7357010-901d-48fb-8a99-1a57605ab309 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:41.521055 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d7357010-901d-48fb-8a99-1a57605ab309 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:41.528597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d7357010-901d-48fb-8a99-1a57605ab309 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:41.529040 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d7357010-901d-48fb-8a99-1a57605ab309 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:41.529835 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d7357010-901d-48fb-8a99-1a57605ab309 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:41.530265 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d7357010-901d-48fb-8a99-1a57605ab309 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:41.563819 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d7357010-901d-48fb-8a99-1a57605ab309 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050557 Aug 01 14:19:41.564433 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 514/1010] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 14:19:41 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:19:41.643815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a8314a99-fdaa-4063-9593-a9a2cd0e8491 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:41.644708 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a8314a99-fdaa-4063-9593-a9a2cd0e8491 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:41.655353 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a8314a99-fdaa-4063-9593-a9a2cd0e8491 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:41.655796 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a8314a99-fdaa-4063-9593-a9a2cd0e8491 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:41.656630 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a8314a99-fdaa-4063-9593-a9a2cd0e8491 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:41.657468 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a8314a99-fdaa-4063-9593-a9a2cd0e8491 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:41.688890 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a8314a99-fdaa-4063-9593-a9a2cd0e8491 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Going to try to terminate instance {{(pid=118110) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:19:41.772637 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a8314a99-fdaa-4063-9593-a9a2cd0e8491 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 204 len: 0 microversion: 2.1 time: 0.135495 Aug 01 14:19:41.773147 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 497/1011] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:19:41 2022] DELETE /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:19:41.785382 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a6280703-c2a8-463f-8d11-c0000bd0a198 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:41.787131 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a6280703-c2a8-463f-8d11-c0000bd0a198 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:41.796070 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6280703-c2a8-463f-8d11-c0000bd0a198 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:41.796558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6280703-c2a8-463f-8d11-c0000bd0a198 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:41.797342 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6280703-c2a8-463f-8d11-c0000bd0a198 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:41.797774 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6280703-c2a8-463f-8d11-c0000bd0a198 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:41.939154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a6280703-c2a8-463f-8d11-c0000bd0a198 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:41.947209 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a6280703-c2a8-463f-8d11-c0000bd0a198 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1683 microversion: 2.1 time: 0.169113 Aug 01 14:19:41.947873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 515/1012] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:41 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:42.971831 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d31e7236-03a3-49c4-9aad-fb4f04303eec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:42.972714 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d31e7236-03a3-49c4-9aad-fb4f04303eec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:42.980997 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d31e7236-03a3-49c4-9aad-fb4f04303eec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:42.981446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d31e7236-03a3-49c4-9aad-fb4f04303eec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:42.982225 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d31e7236-03a3-49c4-9aad-fb4f04303eec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:42.982661 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d31e7236-03a3-49c4-9aad-fb4f04303eec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:43.002897 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:43.136492 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d31e7236-03a3-49c4-9aad-fb4f04303eec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:43.150216 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d31e7236-03a3-49c4-9aad-fb4f04303eec tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1683 microversion: 2.1 time: 0.183486 Aug 01 14:19:43.151322 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 498/1013] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:42 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:44.173376 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d769174a-77d8-4117-a160-2235d2937b9d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:44.173986 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d769174a-77d8-4117-a160-2235d2937b9d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:44.181560 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d769174a-77d8-4117-a160-2235d2937b9d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:44.182008 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d769174a-77d8-4117-a160-2235d2937b9d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:44.182795 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d769174a-77d8-4117-a160-2235d2937b9d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:44.183227 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d769174a-77d8-4117-a160-2235d2937b9d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:44.282853 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d769174a-77d8-4117-a160-2235d2937b9d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fc33bdca304c33b6a78122a54f492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87d8b3358945aa88acbdc4246917ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:44.297485 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d769174a-77d8-4117-a160-2235d2937b9d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 200 len: 1616 microversion: 2.1 time: 0.127820 Aug 01 14:19:44.298341 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 516/1014] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:44 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 1616 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:44.328256 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-14735419-4569-48aa-8dde-d8781eca4fb1 req-70f83a27-971a-4e9f-80f0-b4d5bd712abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6cdfa01-7170-497f-bdfa-a6e5d95e4007", "name": "network-vif-deleted", "tag": "635a99d2-0a61-4a73-a3d0-fdf636d39a2f"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:44.340823 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-14735419-4569-48aa-8dde-d8781eca4fb1 req-70f83a27-971a-4e9f-80f0-b4d5bd712abc service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:44.341587 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-14735419-4569-48aa-8dde-d8781eca4fb1 req-70f83a27-971a-4e9f-80f0-b4d5bd712abc service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:44.355560 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-14735419-4569-48aa-8dde-d8781eca4fb1 req-70f83a27-971a-4e9f-80f0-b4d5bd712abc service nova] Creating event network-vif-deleted:635a99d2-0a61-4a73-a3d0-fdf636d39a2f for instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 on hv-cinder-84517 Aug 01 14:19:44.360980 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-14735419-4569-48aa-8dde-d8781eca4fb1 req-70f83a27-971a-4e9f-80f0-b4d5bd712abc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036698 Aug 01 14:19:44.363409 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 499/1015] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:19:45.321306 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:45.322147 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:45.329412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:45.329932 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:45.331219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:45.331582 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:45.347056 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 HTTP/1.1 Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:19:45.349107 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:45.350952 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': 'f6cdfa01-7170-497f-bdfa-a6e5d95e4007'} Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:45.355291 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:45.356969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:45.358928 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:45.358928 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9abb5a11-66ec-4a1f-be73-2d496ec51a6d tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 404 len: 111 microversion: 2.1 time: 0.034583 Aug 01 14:19:45.358928 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 517/1016] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:45 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:45.361675 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-f728bbaf-5d80-4f7d-aa09-3d78f2e3710e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '.version_select at 0x7fc57a0560d0>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:45.381618 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-f728bbaf-5d80-4f7d-aa09-3d78f2e3710e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647228630" status: 202 len: 0 microversion: 2.1 time: 0.024821 Aug 01 14:19:45.382351 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 500/1017] 10.222.0.45 () {58 vars in 1221 bytes} [Mon Aug 1 14:19:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647228630 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:19:47.221558 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:47.222144 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:47.224397 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=31 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:47.229641 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:47.230092 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:47.230865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:47.231300 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:47.234941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:47.248391 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 HTTP/1.1 Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:19:47.249951 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.251415 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': 'f6cdfa01-7170-497f-bdfa-a6e5d95e4007'} Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:47.252258 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.253597 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.254897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:47.254897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cc2cd57b-bfe9-4107-ac79-cffc703fa83c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 404 len: 111 microversion: 2.1 time: 0.033967 Aug 01 14:19:47.254897 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 518/1018] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:19:47 2022] DELETE /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:47.260752 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:47.261511 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: f6cdfa01-7170-497f-bdfa-a6e5d95e4007] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:47.264203 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:47.271095 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:47.271543 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:47.272348 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:47.272786 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:47.289564 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 HTTP/1.1 Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:19:47.291269 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.292947 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': 'f6cdfa01-7170-497f-bdfa-a6e5d95e4007'} Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:47.293965 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. Aug 01 14:19:47.295576 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:47.297103 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance f6cdfa01-7170-497f-bdfa-a6e5d95e4007 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:47.297103 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-71da5dfb-8c9d-475d-85dd-2390cc2af93e tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007" status: 404 len: 111 microversion: 2.1 time: 0.036091 Aug 01 14:19:47.297103 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 501/1019] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:47 2022] GET /compute/v2.1/servers/f6cdfa01-7170-497f-bdfa-a6e5d95e4007 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:48.457561 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:48.458102 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:48.465317 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.465764 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:48.466538 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.466973 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:48.484439 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 HTTP/1.1 Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:19:48.486234 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.487851 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '705cc9b9-fac2-4ec1-8137-d1993552b6a4'} Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:48.488968 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.490498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.492374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:48.492374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-04a7e63d-19d4-441e-969b-5d687b4482a6 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 404 len: 111 microversion: 2.1 time: 0.034342 Aug 01 14:19:48.492374 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 519/1020] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:19:48 2022] DELETE /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:48.497861 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:48.498464 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 705cc9b9-fac2-4ec1-8137-d1993552b6a4] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:48.505442 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.505916 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:48.506853 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.507317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:48.523247 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 HTTP/1.1 Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:19:48.524849 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.526479 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '705cc9b9-fac2-4ec1-8137-d1993552b6a4'} Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:48.527369 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. Aug 01 14:19:48.528869 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.530507 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance 705cc9b9-fac2-4ec1-8137-d1993552b6a4 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:48.530507 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-ec5b91ca-5f3c-4b0b-a581-a6b54aef358f tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4" status: 404 len: 111 microversion: 2.1 time: 0.032721 Aug 01 14:19:48.530507 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 502/1021] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:48 2022] GET /compute/v2.1/servers/705cc9b9-fac2-4ec1-8137-d1993552b6a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:48.535430 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:48.535967 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:48.543880 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.544098 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:48.544789 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.545213 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:48.560939 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 HTTP/1.1 Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:19:48.562513 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.564340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '9704aec6-fe5a-451d-9716-53653d6d48f2'} Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:48.565412 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.566708 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.568149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:48.568149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-32f588d8-7fda-4c1a-9913-010f70373390 tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 404 len: 111 microversion: 2.1 time: 0.032730 Aug 01 14:19:48.568149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 520/1022] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:19:48 2022] DELETE /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:48.576212 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:48.576864 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 9704aec6-fe5a-451d-9716-53653d6d48f2] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:48.585136 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.585584 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:48.586366 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.586806 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:48.601630 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 HTTP/1.1 Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:19:48.603386 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.605146 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '9704aec6-fe5a-451d-9716-53653d6d48f2'} Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:48.606125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. Aug 01 14:19:48.607639 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:48.609214 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance 9704aec6-fe5a-451d-9716-53653d6d48f2 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:48.609214 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-4665ac57-de46-4b45-bf14-89c80bd8778c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2" status: 404 len: 111 microversion: 2.1 time: 0.035358 Aug 01 14:19:48.609214 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 503/1023] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:48 2022] GET /compute/v2.1/servers/9704aec6-fe5a-451d-9716-53653d6d48f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:49.761211 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:49.762010 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:49.770320 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:49.770773 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:49.771555 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:49.771987 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:49.793488 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 HTTP/1.1 Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept: application/json Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Connection: close Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Length: 0 Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Content-Type: application/json Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Host: 10.222.0.45 Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Id: None Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Domain-Name: None Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Role: reader,member Aug 01 14:19:49.795525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Roles: reader,member Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: method: > Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: exception: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.797219 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: action_args: {'id': '730a6765-52cd-4528-9957-3165769c0820'} Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:49.798149 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.799609 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.801298 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:49.801298 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1a15e24d-7ee8-48ce-9fc4-63e75ca32e7c tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "DELETE /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 404 len: 111 microversion: 2.1 time: 0.041874 Aug 01 14:19:49.801298 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 521/1024] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:19:49 2022] DELETE /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:19:49.812367 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:49.814068 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] [instance: 730a6765-52cd-4528-9957-3165769c0820] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:49.826666 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:49.827384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:49.828764 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:49.829521 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:49.853733 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] HTTP exception thrown: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Request method failure captured: Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 HTTP/1.1 Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi59_pWjmKmtEpxAigL_cG0VPLj46_80iNlCrZpt_qdtuCItsd7uqVDj6rjEzc6EkzQjrVtcERxpJF9txFYecN-G0mKQL7fBU0d7HlYU6KQPYskRdYXDJ6Xaaw-WmCPfC7z3YpzTQaQ9gQeSPAHpBBWwpoKD5K8M7q5T9KBoDblB_V_ac Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:19:49.856798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87d8b3358945aa88acbdc4246917ae", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87d8b3358945aa88acbdc4246917ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87d8b3358945aa88acbdc4246917ae"}]}] Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: db87d8b3358945aa88acbdc4246917ae Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1583776842 Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: a9fc33bdca304c33b6a78122a54f492a Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-AttachVolumeNegativeTest-1583776842-project Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.858465 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '730a6765-52cd-4528-9957-3165769c0820'} Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:19:49.859359 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. Aug 01 14:19:49.861011 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:19:49.862381 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] Returning 404 to user: Instance 730a6765-52cd-4528-9957-3165769c0820 could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:19:49.862381 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-bb984695-6078-475d-8cc5-4b669f5c64ef tempest-AttachVolumeNegativeTest-1583776842 tempest-AttachVolumeNegativeTest-1583776842-project] 10.222.0.45 "GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820" status: 404 len: 111 microversion: 2.1 time: 0.056546 Aug 01 14:19:49.862381 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 504/1025] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:49 2022] GET /compute/v2.1/servers/730a6765-52cd-4528-9957-3165769c0820 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:17.127654 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:20:17.128330 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Mon Aug 1 14:20:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:20:18.286420 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1023622709", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "networks": [{"uuid": "35a7aae2-ba87-44f0-84d2-0c741df20b03"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:18.295732 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=7 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:18.296397 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=7 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:18.347488 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] validate_networks() for [('35a7aae2-ba87-44f0-84d2-0c741df20b03', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:20:18.796184 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:20:18.796671 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:20:18.797137 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:20:18.797565 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:20:18.797972 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:20:18.807778 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:18.808211 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:18.809026 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:18.809448 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:18.828485 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Getting quotas for project 192684124f13419fa3f9aed76ac3e400. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:18.832845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Getting quotas for user 3ad71c665f4f4aebb823e22b4e60a3a2 and project 192684124f13419fa3f9aed76ac3e400. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:18.845474 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:20:18.848106 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:20:18.896604 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9180d7de-ca87-4025-b116-93fde53a6e13 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614042 Aug 01 14:20:18.897750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 522/1026] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:20:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:20:18.910317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-00a3285d-91ec-4ec2-be2b-300cf55aef12 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:18.911259 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-00a3285d-91ec-4ec2-be2b-300cf55aef12 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:18.915118 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=7 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:18.915595 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=12 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:18.979210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-00a3285d-91ec-4ec2-be2b-300cf55aef12 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:18.990964 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-00a3285d-91ec-4ec2-be2b-300cf55aef12 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1219 microversion: 2.1 time: 0.085622 Aug 01 14:20:18.992002 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 505/1027] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:18 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:20.027400 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c8e9612d-1fb5-4163-ad7c-e8f98e3e114c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:20.028493 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c8e9612d-1fb5-4163-ad7c-e8f98e3e114c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:20.096620 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c8e9612d-1fb5-4163-ad7c-e8f98e3e114c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:20.103628 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c8e9612d-1fb5-4163-ad7c-e8f98e3e114c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1219 microversion: 2.1 time: 0.083050 Aug 01 14:20:20.104303 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 523/1028] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:20 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:21.125058 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-dcd65e44-2fa5-4e82-839c-dce928c8dab0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:21.125733 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-dcd65e44-2fa5-4e82-839c-dce928c8dab0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:21.198081 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-dcd65e44-2fa5-4e82-839c-dce928c8dab0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:21.206687 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-dcd65e44-2fa5-4e82-839c-dce928c8dab0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1219 microversion: 2.1 time: 0.085560 Aug 01 14:20:21.207767 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 506/1029] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:21 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:22.236691 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b8fac720-5614-4f41-91c0-3b832e4f7074 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:22.237383 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b8fac720-5614-4f41-91c0-3b832e4f7074 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:22.245294 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8fac720-5614-4f41-91c0-3b832e4f7074 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:22.245741 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8fac720-5614-4f41-91c0-3b832e4f7074 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:22.246525 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8fac720-5614-4f41-91c0-3b832e4f7074 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:22.246966 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8fac720-5614-4f41-91c0-3b832e4f7074 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:22.314143 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b8fac720-5614-4f41-91c0-3b832e4f7074 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:22.322070 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b8fac720-5614-4f41-91c0-3b832e4f7074 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1223 microversion: 2.1 time: 0.089391 Aug 01 14:20:22.322634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 524/1030] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:22 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:23.353092 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-a98da3ad-c4ea-4524-a1f8-36faa6687c98 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:23.353717 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-a98da3ad-c4ea-4524-a1f8-36faa6687c98 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:23.361032 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a98da3ad-c4ea-4524-a1f8-36faa6687c98 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:23.361659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a98da3ad-c4ea-4524-a1f8-36faa6687c98 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:23.362562 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a98da3ad-c4ea-4524-a1f8-36faa6687c98 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:23.363005 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-a98da3ad-c4ea-4524-a1f8-36faa6687c98 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:23.450540 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-a98da3ad-c4ea-4524-a1f8-36faa6687c98 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:23.459125 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-a98da3ad-c4ea-4524-a1f8-36faa6687c98 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1277 microversion: 2.1 time: 0.110372 Aug 01 14:20:23.459651 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 507/1031] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:23 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:24.482173 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6fa624f5-3b43-4c1c-ae0a-530a1c98d7dc tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:24.482880 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6fa624f5-3b43-4c1c-ae0a-530a1c98d7dc tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:24.490762 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6fa624f5-3b43-4c1c-ae0a-530a1c98d7dc tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:24.491475 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6fa624f5-3b43-4c1c-ae0a-530a1c98d7dc tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:24.492857 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6fa624f5-3b43-4c1c-ae0a-530a1c98d7dc tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:24.493362 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6fa624f5-3b43-4c1c-ae0a-530a1c98d7dc tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:24.567974 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-c422cb06-9e91-422e-a2c6-a24e00e02501 req-6595b2e7-8273-4920-873a-10611e1c9452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2223bb96-e343-4e2e-9428-108803b71e0f", "tag": "fb7b5bbb-c301-43c1-8cdc-52270a2ca517"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:24.579187 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-c422cb06-9e91-422e-a2c6-a24e00e02501 req-6595b2e7-8273-4920-873a-10611e1c9452 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:24.579999 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-c422cb06-9e91-422e-a2c6-a24e00e02501 req-6595b2e7-8273-4920-873a-10611e1c9452 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:24.592636 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-c422cb06-9e91-422e-a2c6-a24e00e02501 req-6595b2e7-8273-4920-873a-10611e1c9452 service nova] Creating event network-changed:fb7b5bbb-c301-43c1-8cdc-52270a2ca517 for instance 2223bb96-e343-4e2e-9428-108803b71e0f on hv-cinder-84517 Aug 01 14:20:24.599113 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-c422cb06-9e91-422e-a2c6-a24e00e02501 req-6595b2e7-8273-4920-873a-10611e1c9452 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034621 Aug 01 14:20:24.600378 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 508/1032] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:24.823521 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6fa624f5-3b43-4c1c-ae0a-530a1c98d7dc tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:24.834735 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6fa624f5-3b43-4c1c-ae0a-530a1c98d7dc tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1319 microversion: 2.1 time: 0.354498 Aug 01 14:20:24.835366 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 525/1033] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:24 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:25.857017 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-6e2bedeb-188a-4689-ab3a-0f9e3471fcd0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:25.857828 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-6e2bedeb-188a-4689-ab3a-0f9e3471fcd0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:25.868207 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e2bedeb-188a-4689-ab3a-0f9e3471fcd0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:25.868767 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e2bedeb-188a-4689-ab3a-0f9e3471fcd0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:25.869796 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e2bedeb-188a-4689-ab3a-0f9e3471fcd0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:25.870448 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-6e2bedeb-188a-4689-ab3a-0f9e3471fcd0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:26.098573 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-6e2bedeb-188a-4689-ab3a-0f9e3471fcd0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:26.106871 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-6e2bedeb-188a-4689-ab3a-0f9e3471fcd0 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1319 microversion: 2.1 time: 0.254911 Aug 01 14:20:26.107475 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 509/1034] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:25 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:27.140186 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bd5354bd-f750-4044-953e-f66401e6d737 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:27.140841 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bd5354bd-f750-4044-953e-f66401e6d737 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:27.148157 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd5354bd-f750-4044-953e-f66401e6d737 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:27.148625 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd5354bd-f750-4044-953e-f66401e6d737 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:27.149418 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd5354bd-f750-4044-953e-f66401e6d737 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:27.149845 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd5354bd-f750-4044-953e-f66401e6d737 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:27.296392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bd5354bd-f750-4044-953e-f66401e6d737 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:27.304542 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bd5354bd-f750-4044-953e-f66401e6d737 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1319 microversion: 2.1 time: 0.168612 Aug 01 14:20:27.305127 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 526/1035] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:27 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:28.326412 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1508cf25-f0d7-4401-837a-08bee8c61bb8 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:28.327427 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1508cf25-f0d7-4401-837a-08bee8c61bb8 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:28.335464 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1508cf25-f0d7-4401-837a-08bee8c61bb8 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:28.335993 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1508cf25-f0d7-4401-837a-08bee8c61bb8 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:28.336891 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1508cf25-f0d7-4401-837a-08bee8c61bb8 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:28.337329 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1508cf25-f0d7-4401-837a-08bee8c61bb8 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:28.502347 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1508cf25-f0d7-4401-837a-08bee8c61bb8 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:28.511795 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1508cf25-f0d7-4401-837a-08bee8c61bb8 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1319 microversion: 2.1 time: 0.189630 Aug 01 14:20:28.512422 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 510/1036] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:28 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:29.535576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cbbfa817-1662-4d97-8b47-5f0b3e181be9 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:29.536366 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cbbfa817-1662-4d97-8b47-5f0b3e181be9 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:29.538873 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:29.546099 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbbfa817-1662-4d97-8b47-5f0b3e181be9 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:29.546551 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbbfa817-1662-4d97-8b47-5f0b3e181be9 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:29.547396 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbbfa817-1662-4d97-8b47-5f0b3e181be9 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:29.547835 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbbfa817-1662-4d97-8b47-5f0b3e181be9 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:29.711203 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cbbfa817-1662-4d97-8b47-5f0b3e181be9 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:29.722316 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cbbfa817-1662-4d97-8b47-5f0b3e181be9 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1319 microversion: 2.1 time: 0.190875 Aug 01 14:20:29.723305 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 527/1037] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:29 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:30.147279 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-4a5d102d-b3b3-4bba-8cca-992f9c5d9d98 req-541e8ad5-58b8-450c-bbef-3141ef647038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2223bb96-e343-4e2e-9428-108803b71e0f", "name": "network-vif-plugged", "status": "completed", "tag": "fb7b5bbb-c301-43c1-8cdc-52270a2ca517"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:30.157945 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-4a5d102d-b3b3-4bba-8cca-992f9c5d9d98 req-541e8ad5-58b8-450c-bbef-3141ef647038 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:30.158384 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-4a5d102d-b3b3-4bba-8cca-992f9c5d9d98 req-541e8ad5-58b8-450c-bbef-3141ef647038 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:30.171267 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-4a5d102d-b3b3-4bba-8cca-992f9c5d9d98 req-541e8ad5-58b8-450c-bbef-3141ef647038 service nova] Creating event network-vif-plugged:fb7b5bbb-c301-43c1-8cdc-52270a2ca517 for instance 2223bb96-e343-4e2e-9428-108803b71e0f on hv-cinder-84517 Aug 01 14:20:30.176725 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-4a5d102d-b3b3-4bba-8cca-992f9c5d9d98 req-541e8ad5-58b8-450c-bbef-3141ef647038 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251208 Aug 01 14:20:30.177446 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 511/1038] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:30.747427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5bf5de45-c29e-4ea7-8e61-0f33dc174808 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:30.748577 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5bf5de45-c29e-4ea7-8e61-0f33dc174808 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:30.751751 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=8 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:30.761891 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5bf5de45-c29e-4ea7-8e61-0f33dc174808 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:30.762613 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5bf5de45-c29e-4ea7-8e61-0f33dc174808 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:30.764116 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5bf5de45-c29e-4ea7-8e61-0f33dc174808 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:30.764866 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5bf5de45-c29e-4ea7-8e61-0f33dc174808 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:30.908839 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5bf5de45-c29e-4ea7-8e61-0f33dc174808 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:30.916914 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5bf5de45-c29e-4ea7-8e61-0f33dc174808 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1319 microversion: 2.1 time: 0.176811 Aug 01 14:20:30.917497 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 528/1039] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:30 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:31.936000 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=4 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:31.940177 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-fc3479dc-22f7-4d98-abaf-8524d172c79d tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:31.940938 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-fc3479dc-22f7-4d98-abaf-8524d172c79d tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:31.948389 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fc3479dc-22f7-4d98-abaf-8524d172c79d tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:31.948857 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fc3479dc-22f7-4d98-abaf-8524d172c79d tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:31.949619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fc3479dc-22f7-4d98-abaf-8524d172c79d tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:31.950058 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-fc3479dc-22f7-4d98-abaf-8524d172c79d tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:32.098201 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-fc3479dc-22f7-4d98-abaf-8524d172c79d tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:32.111981 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-fc3479dc-22f7-4d98-abaf-8524d172c79d tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1508 microversion: 2.1 time: 0.177077 Aug 01 14:20:32.113082 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 512/1040] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:31 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:47.466563 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1f6e2600-5272-4087-9114-a0a0550ef3b4 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0ec09fc-caca-452f-b6ea-003b0d16433e", "device": "/dev/sdb"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:47.469860 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1f6e2600-5272-4087-9114-a0a0550ef3b4 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:47.472013 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:47.472734 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=32 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:47.479337 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f6e2600-5272-4087-9114-a0a0550ef3b4 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:47.479770 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f6e2600-5272-4087-9114-a0a0550ef3b4 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:47.480618 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f6e2600-5272-4087-9114-a0a0550ef3b4 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:47.481054 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f6e2600-5272-4087-9114-a0a0550ef3b4 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:47.752683 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1f6e2600-5272-4087-9114-a0a0550ef3b4 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "POST /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289897 Aug 01 14:20:47.753340 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 529/1041] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:20:47 2022] POST /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:09.570220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-5ca6355c-b290-41f4-b75b-7520e0041e68 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:09.570885 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-5ca6355c-b290-41f4-b75b-7520e0041e68 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.573001 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=20 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:09.573992 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=28 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:09.580584 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5ca6355c-b290-41f4-b75b-7520e0041e68 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.581027 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5ca6355c-b290-41f4-b75b-7520e0041e68 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.581810 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5ca6355c-b290-41f4-b75b-7520e0041e68 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.582261 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-5ca6355c-b290-41f4-b75b-7520e0041e68 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.669176 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-5ca6355c-b290-41f4-b75b-7520e0041e68 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lazy-loading 'services' on Instance uuid 2223bb96-e343-4e2e-9428-108803b71e0f {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:21:09.751630 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-5ca6355c-b290-41f4-b75b-7520e0041e68 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f/os-volume_attachments/b0ec09fc-caca-452f-b6ea-003b0d16433e" status: 202 len: 0 microversion: 2.1 time: 0.185620 Aug 01 14:21:09.752302 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 513/1042] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:21:09 2022] DELETE /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f/os-volume_attachments/b0ec09fc-caca-452f-b6ea-003b0d16433e => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:21:10.881269 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ad1569e7-822c-4d42-9548-ed796192b101 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:10.882088 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ad1569e7-822c-4d42-9548-ed796192b101 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:10.884536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:10.885228 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:10.895735 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad1569e7-822c-4d42-9548-ed796192b101 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.896563 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad1569e7-822c-4d42-9548-ed796192b101 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.897929 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad1569e7-822c-4d42-9548-ed796192b101 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.898668 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad1569e7-822c-4d42-9548-ed796192b101 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.930544 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ad1569e7-822c-4d42-9548-ed796192b101 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:21:11.015868 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ad1569e7-822c-4d42-9548-ed796192b101 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 204 len: 0 microversion: 2.1 time: 0.138297 Aug 01 14:21:11.016502 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 530/1043] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:10 2022] DELETE /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:21:11.030153 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-330d6a55-0b56-4a19-9636-e6c5fad82255 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:11.031536 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-330d6a55-0b56-4a19-9636-e6c5fad82255 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:11.040528 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-330d6a55-0b56-4a19-9636-e6c5fad82255 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:11.040974 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-330d6a55-0b56-4a19-9636-e6c5fad82255 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:11.041799 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-330d6a55-0b56-4a19-9636-e6c5fad82255 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:11.042271 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-330d6a55-0b56-4a19-9636-e6c5fad82255 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:11.189270 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-330d6a55-0b56-4a19-9636-e6c5fad82255 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:11.197426 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-330d6a55-0b56-4a19-9636-e6c5fad82255 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1514 microversion: 2.1 time: 0.174757 Aug 01 14:21:11.197999 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 514/1044] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:11 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:12.221104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-edb0d582-e12d-4831-9cd5-e1033635129a tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:12.222369 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-edb0d582-e12d-4831-9cd5-e1033635129a tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:12.235060 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-edb0d582-e12d-4831-9cd5-e1033635129a tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:12.235782 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-edb0d582-e12d-4831-9cd5-e1033635129a tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:12.237173 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-edb0d582-e12d-4831-9cd5-e1033635129a tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:12.237933 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-edb0d582-e12d-4831-9cd5-e1033635129a tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:12.397027 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-edb0d582-e12d-4831-9cd5-e1033635129a tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:12.405023 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-edb0d582-e12d-4831-9cd5-e1033635129a tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1514 microversion: 2.1 time: 0.189482 Aug 01 14:21:12.405970 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 531/1045] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:12 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:13.159752 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-fb12d5e5-4770-46dc-a066-e5d003e35d85 req-1dbbb55a-562a-4f36-b91d-b8107b17bf24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2223bb96-e343-4e2e-9428-108803b71e0f", "name": "network-vif-deleted", "tag": "fb7b5bbb-c301-43c1-8cdc-52270a2ca517"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:13.169899 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-fb12d5e5-4770-46dc-a066-e5d003e35d85 req-1dbbb55a-562a-4f36-b91d-b8107b17bf24 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.170398 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-fb12d5e5-4770-46dc-a066-e5d003e35d85 req-1dbbb55a-562a-4f36-b91d-b8107b17bf24 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.181747 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-fb12d5e5-4770-46dc-a066-e5d003e35d85 req-1dbbb55a-562a-4f36-b91d-b8107b17bf24 service nova] Creating event network-vif-deleted:fb7b5bbb-c301-43c1-8cdc-52270a2ca517 for instance 2223bb96-e343-4e2e-9428-108803b71e0f on hv-cinder-84517 Aug 01 14:21:13.186584 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-fb12d5e5-4770-46dc-a066-e5d003e35d85 req-1dbbb55a-562a-4f36-b91d-b8107b17bf24 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030876 Aug 01 14:21:13.187413 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 515/1046] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:13.426941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:13.427536 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:13.434720 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.435181 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.435969 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.436458 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.469333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.469779 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.470238 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lazy-loading 'fault' on Instance uuid 2223bb96-e343-4e2e-9428-108803b71e0f {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:21:13.518455 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:13.534035 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-383f9994-e3e2-435a-969c-05d0df09816b tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 200 len: 1309 microversion: 2.1 time: 0.110162 Aug 01 14:21:13.534719 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 532/1047] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:13 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:14.566121 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:14.566863 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: 2223bb96-e343-4e2e-9428-108803b71e0f] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:14.574366 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:14.574818 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:14.575607 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:14.576142 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:14.592477 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] HTTP exception thrown: Instance 2223bb96-e343-4e2e-9428-108803b71e0f could not be found. Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Request method failure captured: Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f HTTP/1.1 Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi5-Egud6yFn4HSU7ga3sEIePazFyqtcYiCBAxiMDVCaTCdf-Wn-kpezM7oJ8Y-2a5PW1EV-IhoJiEvIr33A52HbSU3lrWw60lquSgy8ePw3g2NzXLQBvQJTTc-IZvJ0EIeVZ4Lz68Uqp84Lnd02sZfi2pzNGRKhzErqIPyojZmJfWxC0 Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 192684124f13419fa3f9aed76ac3e400 Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1930537616 Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:21:14.594204 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_192684124f13419fa3f9aed76ac3e400", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/192684124f13419fa3f9aed76ac3e400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/192684124f13419fa3f9aed76ac3e400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/192684124f13419fa3f9aed76ac3e400"}]}] Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-VolumesSnapshotTestJSON-1930537616 Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 192684124f13419fa3f9aed76ac3e400 Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1930537616 Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-VolumesSnapshotTestJSON-1930537616-project Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 3ad71c665f4f4aebb823e22b4e60a3a2 Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-VolumesSnapshotTestJSON-1930537616-project Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance 2223bb96-e343-4e2e-9428-108803b71e0f could not be found. Aug 01 14:21:14.596120 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': '2223bb96-e343-4e2e-9428-108803b71e0f'} Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2223bb96-e343-4e2e-9428-108803b71e0f could not be found. Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:14.597090 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2223bb96-e343-4e2e-9428-108803b71e0f could not be found. Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2223bb96-e343-4e2e-9428-108803b71e0f could not be found. Aug 01 14:21:14.598879 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:14.600424 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Returning 404 to user: Instance 2223bb96-e343-4e2e-9428-108803b71e0f could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:14.600424 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-42d45d5a-7053-45d3-99a0-6b3d20021990 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f" status: 404 len: 111 microversion: 2.1 time: 0.034570 Aug 01 14:21:14.600424 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 516/1048] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:14 2022] GET /compute/v2.1/servers/2223bb96-e343-4e2e-9428-108803b71e0f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:22.513616 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-436640869", "imageRef": "df5be71c-0209-4338-bf85-3a0d424d4bc9", "flavorRef": "452", "networks": [{"uuid": "35a7aae2-ba87-44f0-84d2-0c741df20b03"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:22.581624 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] validate_networks() for [('35a7aae2-ba87-44f0-84d2-0c741df20b03', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:21:22.973551 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:21:22.973976 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:21:22.974447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:21:22.974855 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:21:22.975269 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:21:22.985702 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.986140 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.986941 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.987372 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:23.009766 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Getting quotas for project 192684124f13419fa3f9aed76ac3e400. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:21:23.014581 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Getting quotas for user 3ad71c665f4f4aebb823e22b4e60a3a2 and project 192684124f13419fa3f9aed76ac3e400. Resources: {'cores', 'instances', 'ram'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:21:23.027230 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:21:23.029634 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df5be71c-0209-4338-bf85-3a0d424d4bc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:21:23.080615 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fb0db625-c245-48b8-8e42-288348971f99 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571101 Aug 01 14:21:23.081498 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 533/1049] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 14:21:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:21:23.092950 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-10b383b7-ede0-4cc8-bd1e-4dd19a859386 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:23.093810 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-10b383b7-ede0-4cc8-bd1e-4dd19a859386 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:23.170147 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-10b383b7-ede0-4cc8-bd1e-4dd19a859386 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:23.180619 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-10b383b7-ede0-4cc8-bd1e-4dd19a859386 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1218 microversion: 2.1 time: 0.091758 Aug 01 14:21:23.181444 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 517/1050] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:23 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:24.205839 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3288d226-20be-4d0b-b0a5-61d7ea9cc38c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:24.207152 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3288d226-20be-4d0b-b0a5-61d7ea9cc38c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:24.215362 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3288d226-20be-4d0b-b0a5-61d7ea9cc38c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.216618 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3288d226-20be-4d0b-b0a5-61d7ea9cc38c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.217538 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3288d226-20be-4d0b-b0a5-61d7ea9cc38c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.218177 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3288d226-20be-4d0b-b0a5-61d7ea9cc38c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.319327 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3288d226-20be-4d0b-b0a5-61d7ea9cc38c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:24.332761 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3288d226-20be-4d0b-b0a5-61d7ea9cc38c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1288 microversion: 2.1 time: 0.134210 Aug 01 14:21:24.337591 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 534/1051] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:24 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1288 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:25.356960 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-da4c8c90-7bac-443e-ac44-5d09fc1892ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:25.358053 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-da4c8c90-7bac-443e-ac44-5d09fc1892ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:25.361329 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:25.370528 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-da4c8c90-7bac-443e-ac44-5d09fc1892ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.371100 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-da4c8c90-7bac-443e-ac44-5d09fc1892ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.372173 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-da4c8c90-7bac-443e-ac44-5d09fc1892ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.372886 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-da4c8c90-7bac-443e-ac44-5d09fc1892ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.598317 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-da4c8c90-7bac-443e-ac44-5d09fc1892ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:25.606534 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-da4c8c90-7bac-443e-ac44-5d09fc1892ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1318 microversion: 2.1 time: 0.255672 Aug 01 14:21:25.607293 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 518/1052] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:25 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:25.698154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-f37fa617-194b-400d-ac93-80b40f16fc0d req-2b3df33d-6437-4519-977a-2c0fe6f06101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17701b4-a8a8-4df9-9186-7ef14149171a", "tag": "21af456b-0cfd-46ad-b094-9e1bd7c3e5e1"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:25.712029 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-f37fa617-194b-400d-ac93-80b40f16fc0d req-2b3df33d-6437-4519-977a-2c0fe6f06101 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.712539 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-f37fa617-194b-400d-ac93-80b40f16fc0d req-2b3df33d-6437-4519-977a-2c0fe6f06101 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.727958 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-f37fa617-194b-400d-ac93-80b40f16fc0d req-2b3df33d-6437-4519-977a-2c0fe6f06101 service nova] Creating event network-changed:21af456b-0cfd-46ad-b094-9e1bd7c3e5e1 for instance b17701b4-a8a8-4df9-9186-7ef14149171a on hv-cinder-84517 Aug 01 14:21:25.733202 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-f37fa617-194b-400d-ac93-80b40f16fc0d req-2b3df33d-6437-4519-977a-2c0fe6f06101 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038885 Aug 01 14:21:25.734063 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 535/1053] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:26.641115 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-1de62b64-9830-4aa2-bac4-0f2f4bc9b928 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:26.641732 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-1de62b64-9830-4aa2-bac4-0f2f4bc9b928 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:26.648862 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1de62b64-9830-4aa2-bac4-0f2f4bc9b928 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.649358 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1de62b64-9830-4aa2-bac4-0f2f4bc9b928 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.650139 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1de62b64-9830-4aa2-bac4-0f2f4bc9b928 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.650687 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-1de62b64-9830-4aa2-bac4-0f2f4bc9b928 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.797747 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-1de62b64-9830-4aa2-bac4-0f2f4bc9b928 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:26.805736 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-1de62b64-9830-4aa2-bac4-0f2f4bc9b928 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1318 microversion: 2.1 time: 0.168683 Aug 01 14:21:26.806340 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 519/1054] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:26 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:27.828082 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-85faf02c-85ee-4cd7-aaf8-9f023baca480 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:27.828801 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-85faf02c-85ee-4cd7-aaf8-9f023baca480 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:27.836621 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85faf02c-85ee-4cd7-aaf8-9f023baca480 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.837030 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85faf02c-85ee-4cd7-aaf8-9f023baca480 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.837865 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85faf02c-85ee-4cd7-aaf8-9f023baca480 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.838293 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-85faf02c-85ee-4cd7-aaf8-9f023baca480 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.988231 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-85faf02c-85ee-4cd7-aaf8-9f023baca480 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:27.996737 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-85faf02c-85ee-4cd7-aaf8-9f023baca480 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1318 microversion: 2.1 time: 0.172913 Aug 01 14:21:27.997317 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 536/1055] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:27 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:29.018084 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0109e674-aecc-4328-91a0-3ec6c264db72 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:29.018742 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0109e674-aecc-4328-91a0-3ec6c264db72 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:29.026471 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0109e674-aecc-4328-91a0-3ec6c264db72 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:29.026929 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0109e674-aecc-4328-91a0-3ec6c264db72 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.027740 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0109e674-aecc-4328-91a0-3ec6c264db72 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:29.028160 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0109e674-aecc-4328-91a0-3ec6c264db72 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.192905 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0109e674-aecc-4328-91a0-3ec6c264db72 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:29.202350 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0109e674-aecc-4328-91a0-3ec6c264db72 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1318 microversion: 2.1 time: 0.186940 Aug 01 14:21:29.203348 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 520/1056] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:29 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:30.182750 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-c9f448b0-d276-4b08-a8bf-8b00fe153d1a req-d5812cbd-1064-4575-b068-fac95a4910e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17701b4-a8a8-4df9-9186-7ef14149171a", "name": "network-vif-plugged", "status": "completed", "tag": "21af456b-0cfd-46ad-b094-9e1bd7c3e5e1"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:30.202007 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c9f448b0-d276-4b08-a8bf-8b00fe153d1a req-d5812cbd-1064-4575-b068-fac95a4910e4 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.202961 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c9f448b0-d276-4b08-a8bf-8b00fe153d1a req-d5812cbd-1064-4575-b068-fac95a4910e4 service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.218018 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-c9f448b0-d276-4b08-a8bf-8b00fe153d1a req-d5812cbd-1064-4575-b068-fac95a4910e4 service nova] Creating event network-vif-plugged:21af456b-0cfd-46ad-b094-9e1bd7c3e5e1 for instance b17701b4-a8a8-4df9-9186-7ef14149171a on hv-cinder-84517 Aug 01 14:21:30.226490 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-0762a52a-1098-4ebe-bb79-d2847814a413 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:30.227133 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-c9f448b0-d276-4b08-a8bf-8b00fe153d1a req-d5812cbd-1064-4575-b068-fac95a4910e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051254 Aug 01 14:21:30.228264 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 537/1057] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:30.228798 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-0762a52a-1098-4ebe-bb79-d2847814a413 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:30.245769 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0762a52a-1098-4ebe-bb79-d2847814a413 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.246214 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0762a52a-1098-4ebe-bb79-d2847814a413 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.247237 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0762a52a-1098-4ebe-bb79-d2847814a413 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.250036 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-0762a52a-1098-4ebe-bb79-d2847814a413 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.423973 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-0762a52a-1098-4ebe-bb79-d2847814a413 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:30.433035 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-0762a52a-1098-4ebe-bb79-d2847814a413 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1318 microversion: 2.1 time: 0.210397 Aug 01 14:21:30.433659 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 521/1058] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:30 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:31.455154 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0c727042-4d40-460b-afbe-c198dc4c3140 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:31.456085 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0c727042-4d40-460b-afbe-c198dc4c3140 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:31.465778 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c727042-4d40-460b-afbe-c198dc4c3140 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:31.466527 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c727042-4d40-460b-afbe-c198dc4c3140 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:31.467884 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c727042-4d40-460b-afbe-c198dc4c3140 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:31.468624 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c727042-4d40-460b-afbe-c198dc4c3140 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:31.652928 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0c727042-4d40-460b-afbe-c198dc4c3140 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:31.661380 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0c727042-4d40-460b-afbe-c198dc4c3140 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1318 microversion: 2.1 time: 0.211064 Aug 01 14:21:31.662002 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 538/1059] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:31 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:32.689586 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-d7a58e26-425a-4c7e-b2b3-27047fee3f02 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:32.690247 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-d7a58e26-425a-4c7e-b2b3-27047fee3f02 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:32.697757 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d7a58e26-425a-4c7e-b2b3-27047fee3f02 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:32.698104 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d7a58e26-425a-4c7e-b2b3-27047fee3f02 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:32.698856 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d7a58e26-425a-4c7e-b2b3-27047fee3f02 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:32.699304 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-d7a58e26-425a-4c7e-b2b3-27047fee3f02 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:32.842332 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-d7a58e26-425a-4c7e-b2b3-27047fee3f02 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:32.850541 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-d7a58e26-425a-4c7e-b2b3-27047fee3f02 tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1506 microversion: 2.1 time: 0.165091 Aug 01 14:21:32.851233 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 522/1060] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:32 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:32.872379 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e9684885-40db-439d-a6b7-be6a51f47d4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf4d45d1-1a1d-4138-ab64-e7ad105b357f", "device": "/dev/sdb"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:32.874786 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e9684885-40db-439d-a6b7-be6a51f47d4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:32.881904 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9684885-40db-439d-a6b7-be6a51f47d4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:32.882333 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9684885-40db-439d-a6b7-be6a51f47d4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:32.883129 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9684885-40db-439d-a6b7-be6a51f47d4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:32.883551 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9684885-40db-439d-a6b7-be6a51f47d4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:32.997055 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:33.023457 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:33.175576 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e9684885-40db-439d-a6b7-be6a51f47d4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "POST /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307105 Aug 01 14:21:33.176242 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 539/1061] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 14:21:32 2022] POST /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:47.584417 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:21:47.587122 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Mon Aug 1 14:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:21:50.721523 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-3d5cc059-b52c-460d-915d-94c789f4ba8e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:50.722178 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-3d5cc059-b52c-460d-915d-94c789f4ba8e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:50.724079 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell0:SELECT=2 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:50.725294 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_api:SELECT=22 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:50.726072 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG dbcounter [-] [118110] Writing DB stats nova_cell1:SELECT=30 {{(pid=118110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:50.732834 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3d5cc059-b52c-460d-915d-94c789f4ba8e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:50.733275 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3d5cc059-b52c-460d-915d-94c789f4ba8e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:50.734049 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3d5cc059-b52c-460d-915d-94c789f4ba8e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:50.734478 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-3d5cc059-b52c-460d-915d-94c789f4ba8e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:50.822993 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.objects.instance [None req-3d5cc059-b52c-460d-915d-94c789f4ba8e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lazy-loading 'services' on Instance uuid b17701b4-a8a8-4df9-9186-7ef14149171a {{(pid=118110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:21:50.906578 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-3d5cc059-b52c-460d-915d-94c789f4ba8e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a/os-volume_attachments/bf4d45d1-1a1d-4138-ab64-e7ad105b357f" status: 202 len: 0 microversion: 2.1 time: 0.189196 Aug 01 14:21:50.907220 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 523/1062] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 14:21:50 2022] DELETE /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a/os-volume_attachments/bf4d45d1-1a1d-4138-ab64-e7ad105b357f => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:21:52.030427 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:52.031322 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:52.035560 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eaff0073-8393-4287-842f-aa4dc87b2aab tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:52.036143 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eaff0073-8393-4287-842f-aa4dc87b2aab tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:52.044066 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eaff0073-8393-4287-842f-aa4dc87b2aab tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.044599 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eaff0073-8393-4287-842f-aa4dc87b2aab tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:52.045419 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eaff0073-8393-4287-842f-aa4dc87b2aab tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.045852 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eaff0073-8393-4287-842f-aa4dc87b2aab tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:52.072590 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eaff0073-8393-4287-842f-aa4dc87b2aab tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:21:52.158373 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eaff0073-8393-4287-842f-aa4dc87b2aab tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 204 len: 0 microversion: 2.1 time: 0.129437 Aug 01 14:21:52.158963 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 540/1063] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:52 2022] DELETE /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:21:52.168420 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-68852474-39e3-4d04-8393-d67dafcb4f4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:52.169106 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-68852474-39e3-4d04-8393-d67dafcb4f4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:52.176671 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-68852474-39e3-4d04-8393-d67dafcb4f4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.177098 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-68852474-39e3-4d04-8393-d67dafcb4f4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:52.177877 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-68852474-39e3-4d04-8393-d67dafcb4f4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.178297 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-68852474-39e3-4d04-8393-d67dafcb4f4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:52.322748 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.policy [None req-68852474-39e3-4d04-8393-d67dafcb4f4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118110) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:52.330877 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-68852474-39e3-4d04-8393-d67dafcb4f4c tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1512 microversion: 2.1 time: 0.166820 Aug 01 14:21:52.331433 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 524/1064] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:52 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:53.353838 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-116af587-a199-4ec4-80dc-31ba6fabf02e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:53.354505 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-116af587-a199-4ec4-80dc-31ba6fabf02e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:53.362214 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-116af587-a199-4ec4-80dc-31ba6fabf02e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:53.362651 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-116af587-a199-4ec4-80dc-31ba6fabf02e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:53.363424 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-116af587-a199-4ec4-80dc-31ba6fabf02e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:53.363839 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-116af587-a199-4ec4-80dc-31ba6fabf02e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:53.510037 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-116af587-a199-4ec4-80dc-31ba6fabf02e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:53.520538 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-116af587-a199-4ec4-80dc-31ba6fabf02e tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1512 microversion: 2.1 time: 0.171094 Aug 01 14:21:53.521660 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 541/1065] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:53 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:54.314961 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [req-2f1bbe73-6eab-40b6-91ae-82c6b1b30094 req-a4675cbf-b097-4ee9-bc78-8238fed883ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17701b4-a8a8-4df9-9186-7ef14149171a", "name": "network-vif-deleted", "tag": "21af456b-0cfd-46ad-b094-9e1bd7c3e5e1"}]} {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:54.325405 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-2f1bbe73-6eab-40b6-91ae-82c6b1b30094 req-a4675cbf-b097-4ee9-bc78-8238fed883ae service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:54.325843 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [req-2f1bbe73-6eab-40b6-91ae-82c6b1b30094 req-a4675cbf-b097-4ee9-bc78-8238fed883ae service nova] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:54.337821 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.compute.server_external_events [req-2f1bbe73-6eab-40b6-91ae-82c6b1b30094 req-a4675cbf-b097-4ee9-bc78-8238fed883ae service nova] Creating event network-vif-deleted:21af456b-0cfd-46ad-b094-9e1bd7c3e5e1 for instance b17701b4-a8a8-4df9-9186-7ef14149171a on hv-cinder-84517 Aug 01 14:21:54.343206 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [req-2f1bbe73-6eab-40b6-91ae-82c6b1b30094 req-a4675cbf-b097-4ee9-bc78-8238fed883ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 Aug 01 14:21:54.344142 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 525/1066] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:54.544104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:54.544104 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:54.550447 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:54.550883 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:54.551638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:54.552232 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:54.584549 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:54.585048 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:54.585489 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lazy-loading 'fault' on Instance uuid b17701b4-a8a8-4df9-9186-7ef14149171a {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:21:54.627638 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad71c665f4f4aebb823e22b4e60a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192684124f13419fa3f9aed76ac3e400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:54.636875 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6c0ec05c-3120-4103-a9f5-723a52bcd5ed tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 200 len: 1308 microversion: 2.1 time: 0.097613 Aug 01 14:21:54.637714 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 542/1067] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:54 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:55.659812 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Calling method '>' {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:55.661160 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.compute.api [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] [instance: b17701b4-a8a8-4df9-9186-7ef14149171a] Fetching instance by UUID {{(pid=118110) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:55.668600 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.669052 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.669840 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.670272 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG oslo_concurrency.lockutils [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Lock "b931c80f-59a5-40eb-8557-eb4bfa964b56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.684778 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.wsgi [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] HTTP exception thrown: Instance b17701b4-a8a8-4df9-9186-7ef14149171a could not be found. Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Request method failure captured: Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: request: GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a HTTP/1.1 Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept: application/json Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Accept-Encoding: identity Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Connection: close Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Length: 0 Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Content-Type: application/json Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Host: 10.222.0.45 Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Openstack-System-Scope: None Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Auth-Token: gAAAAABi5-Egud6yFn4HSU7ga3sEIePazFyqtcYiCBAxiMDVCaTCdf-Wn-kpezM7oJ8Y-2a5PW1EV-IhoJiEvIr33A52HbSU3lrWw60lquSgy8ePw3g2NzXLQBvQJTTc-IZvJ0EIeVZ4Lz68Uqp84Lnd02sZfi2pzNGRKhzErqIPyojZmJfWxC0 Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Id: None Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Domain-Name: None Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Identity-Status: Confirmed Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Is-Admin-Project: True Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Id: default Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Domain-Name: Default Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Id: 192684124f13419fa3f9aed76ac3e400 Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1930537616 Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Role: reader,member Aug 01 14:21:55.686466 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Roles: reader,member Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_192684124f13419fa3f9aed76ac3e400", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/192684124f13419fa3f9aed76ac3e400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/192684124f13419fa3f9aed76ac3e400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/192684124f13419fa3f9aed76ac3e400"}]}] Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant: tempest-VolumesSnapshotTestJSON-1930537616 Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Id: 192684124f13419fa3f9aed76ac3e400 Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1930537616 Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User: tempest-VolumesSnapshotTestJSON-1930537616-project Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Id: default Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Domain-Name: Default Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Id: 3ad71c665f4f4aebb823e22b4e60a3a2 Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: X-User-Name: tempest-VolumesSnapshotTestJSON-1930537616-project Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: method: > Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: exception: Instance b17701b4-a8a8-4df9-9186-7ef14149171a could not be found. Aug 01 14:21:55.687955 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: action_args: {'id': 'b17701b4-a8a8-4df9-9186-7ef14149171a'} Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: {{(pid=118110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b17701b4-a8a8-4df9-9186-7ef14149171a could not be found. Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:55.688815 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17701b4-a8a8-4df9-9186-7ef14149171a could not be found. Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17701b4-a8a8-4df9-9186-7ef14149171a could not be found. Aug 01 14:21:55.690210 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: ERROR nova.api.openstack.wsgi Aug 01 14:21:55.691476 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: DEBUG nova.api.openstack.wsgi [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] Returning 404 to user: Instance b17701b4-a8a8-4df9-9186-7ef14149171a could not be found. {{(pid=118110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:55.691476 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO nova.api.openstack.requestlog [None req-c40926c1-e0c7-4eda-aee2-25c1bf0ae4ad tempest-VolumesSnapshotTestJSON-1930537616 tempest-VolumesSnapshotTestJSON-1930537616-project] 10.222.0.45 "GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a" status: 404 len: 111 microversion: 2.1 time: 0.033149 Aug 01 14:21:55.691476 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: [pid: 118110|app: 0|req: 526/1068] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:55 2022] GET /compute/v2.1/servers/b17701b4-a8a8-4df9-9186-7ef14149171a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:27.098021 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:22:27.099036 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Mon Aug 1 14:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:23:37.138286 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:23:37.139083 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Mon Aug 1 14:23:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:23:40.182943 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:23:40.183503 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Mon Aug 1 14:23:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:25:07.596888 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:25:07.597620 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Mon Aug 1 14:25:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:25:47.108039 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:25:47.108764 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Mon Aug 1 14:25:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:26:57.149762 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:26:57.150526 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Mon Aug 1 14:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:27:00.193392 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:27:00.194243 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Mon Aug 1 14:27:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:27:10.946646 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:27:10.947502 dv-cinder-845178-10-iscsi devstack@n-api.service[118111]: Mon Aug 1 14:27:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:27:13.354577 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:27:13.355376 dv-cinder-845178-10-iscsi devstack@n-api.service[118110]: Mon Aug 1 14:27:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!